Sep 10 18:54:38 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 18:54:38 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 18:54:38 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 18:54:40 devstack cinder-volume[74810]: INFO dbcounter [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Registered counter for database cinder
Sep 10 18:54:40 devstack cinder-volume[74810]: DEBUG oslo_db.sqlalchemy.engines [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 18:54:40 devstack cinder-volume[74810]: DEBUG dbcounter [-] [74810] Writer thread running {{(pid=74810) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 18:54:40 devstack cinder-volume[74810]: INFO cinder.rpc [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 18:54:40 devstack cinder-volume[74810]: INFO cinder.rpc [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 18:54:40 devstack cinder-volume[74810]: DEBUG oslo_db.sqlalchemy.engines [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 18:54:40 devstack cinder-volume[74810]: INFO cinder.volume.manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Determined volume DB was empty at startup.
Sep 10 18:54:40 devstack cinder-volume[74810]: DEBUG cinder.volume.manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74810) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 18:54:40 devstack cinder-volume[74810]: INFO cinder.volume.manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 18:54:40 devstack cinder-volume[74810]: WARNING stevedore.named [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 18:54:40 devstack cinder-volume[74810]: WARNING castellan.key_manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 18:54:40 devstack cinder-volume[74810]: WARNING cinder.keymgr.conf_key_mgr [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 18:54:41 devstack cinder-volume[74810]: DEBUG cinder.volume.drivers.lvm [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74810) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 10 18:54:41 devstack cinder-volume[74810]: DEBUG oslo_concurrency.processutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74810) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_concurrency.processutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] CMD "cinder-rtstool verify" returned: 0 in 1.103s {{(pid=74810) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_db.sqlalchemy.engines [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 18:54:42 devstack cinder-volume[74810]: INFO cinder.rpc [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 10 18:54:42 devstack cinder-volume[74810]: INFO cinder.rpc [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 10 18:54:42 devstack cinder-volume[74810]: WARNING stevedore.named [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 18:54:42 devstack cinder-volume[74810]: WARNING castellan.key_manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 18:54:42 devstack cinder-volume[74810]: INFO cinder.volume.manager [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_db.sqlalchemy.engines [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 18:54:42 devstack cinder-volume[74810]: INFO oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Starting 1 workers
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Started child 74957 {{(pid=74810) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Full set of CONF: {{(pid=74810) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] ******************************************************************************** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Configuration options gathered from: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] ================================================================================ {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] allow_availability_zone_fallback = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] allow_compression_on_image_upload = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] allowed_direct_url_schemes     = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] api_rate_limit                 = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] auth_strategy                  = keystone {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] az_cache_duration              = 3600 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_availability_zone      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_host                   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_name                   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_stats_polling_interval = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backup_api_class               = cinder.backup.api.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backup_name_template           = backup-%s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backup_use_same_host           = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backup_use_temp_snapshot       = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] chap_password                  = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] chap_username                  =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_internal_tenant_project_id = d071b0578f0e4ccea733b34e8e45905d {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_internal_tenant_user_id = 0ea60d39a6e44e4bb378719a4aabe243 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cloned_volume_same_az          = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cluster                        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] compression_format             = gzip {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] compute_api_class              = cinder.compute.nova.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] config_dir                     = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] config_source                  = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74957]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] control_exchange               = openstack {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] debug                          = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] default_availability_zone      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] default_group_type             = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] default_volume_type            = lvmdriver-1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_client_cert             = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_client_cert_key         = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_data_namespace          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_ssl_cert_path           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_ssl_cert_verify         = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] driver_use_ssl                 = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] enable_force_upload            = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] enable_new_services            = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] enable_unsupported_driver      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] enforce_multipath_for_image_xfer = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] filter_function                = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_api_insecure            = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_api_servers             = ['http://192.168.122.70/image'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_api_ssl_compression     = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_ca_certificates_file    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_catalog_info            = image:glance:publicURL {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_certfile                = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_keyfile                 = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_num_retries             = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] glance_request_timeout         = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] goodness_function              = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] graceful_shutdown_timeout      = 5 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] group_api_class                = cinder.group.api.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] host                           = devstack {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_compress_on_upload       = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_conversion_address_space_limit = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_conversion_cpu_limit     = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_conversion_disable       = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_upload_use_cinder_backend = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_upload_use_internal_tenant = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_volume_cache_enabled     = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_volume_cache_max_count   = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] image_volume_cache_max_size_gb = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] init_host_max_objects_retrieval = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iscsi_iotype                   = fileio {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iscsi_target_flags             =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iscsi_write_cache              = on {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iser_helper                    = tgtadm {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iser_ip_address                = 192.168.122.70 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iser_port                      = 3260 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_color                      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_config_append              = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_dir                        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_file                       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_options                    = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_rotate_interval            = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_rotate_interval_type       = days {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] log_rotation_type              = none {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] max_age                        = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] max_logfile_count              = 30 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] max_logfile_size_mb            = 200 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] max_over_subscription_ratio    = 20.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] message_reap_interval          = 86400 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] message_ttl                    = 2592000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] migration_create_volume_timeout_secs = 300 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] monkey_patch                   = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] monkey_patch_modules           = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] my_ip                          = 192.168.122.70 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] no_snapshot_gb_quota           = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] num_iser_scan_tries            = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] num_shell_tries                = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] num_volume_device_scan_tries   = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] nvmeof_conn_info_version       = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] nvmet_ns_id                    = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] nvmet_port_id                  = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_max_limit                = 1000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_ext_list          = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_listen_port       = 8776 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_use_ssl           = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] osapi_volume_workers           = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] per_volume_size_limit          = -1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] periodic_fuzzy_delay           = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] periodic_interval              = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] public_endpoint                = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] publish_errors                 = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_backup_gigabytes         = 1000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_backups                  = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_gigabytes                = 1000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_groups                   = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_snapshots                = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] quota_volumes                  = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] rate_limit_burst               = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] rate_limit_except_level        = CRITICAL {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] rate_limit_interval            = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] reinit_driver_count            = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] replication_device             = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] report_discard_supported       = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] report_interval                = 120 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] reservation_clean_interval     = 86400 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] reservation_expire             = 86400 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] reserved_image_namespaces      = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:42 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] reserved_percentage            = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] rpc_response_timeout           = 120 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] run_external_periodic_tasks    = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] scst_target_driver             = iscsi {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] scst_target_iqn_name           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_down_time              = 720 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] shell_completion               = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] snapshot_name_template         = snapshot-%s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] snapshot_same_host             = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] split_loggers                  = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] state_path                     = /opt/stack/data/cinder {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] storage_availability_zone      = nova {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] storage_protocol               = iSCSI {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] syslog_log_facility            = LOG_USER {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_helper                  = lioadm {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_ip_address              = 192.168.122.70 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_port                    = 3260 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_protocol                = iscsi {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] target_secondary_ip_addresses  = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] trace_flags                    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] transport_url                  = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] until_refresh                  = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_chap_auth                  = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_default_quota_class        = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_journal                    = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_json                       = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_multipath_for_image_xfer   = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_stderr                     = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] use_syslog                     = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] verify_glance_signatures       = enabled {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_api_class               = cinder.volume.api.API {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_backend_name            = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_clear                   = zero {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_clear_ionice            = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_clear_size              = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_copy_bps_limit          = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_dd_blocksize            = 1M {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_name_template           = volume-%s {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_service_inithost_offload = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volume_usage_audit_period      = month {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] watch_log_file                 = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] zoning_mode                    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_concurrency.disable_process_locking = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.admin_password = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.admin_token = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.admin_user  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_port   = 35357 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_protocol = https {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_section = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_type   = password {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_uri    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.auth_version = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.cache       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.certfile    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.identity_uri = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.include_service_catalog = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.insecure    = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.interface   = public {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.keyfile     = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_password =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcache_username =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.region_name = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.service_token_roles_required = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.service_type = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.backend                  = dogpile.cache.null {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.backend_argument         = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.backend_expiration_time  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.config_prefix            = cache.oslo {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.dead_timeout             = 60.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74957]: INFO cinder.volume.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.debug_cache_backend      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.enable_retry_client      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.enable_socket_keepalive  = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.enabled                  = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.enforce_fips_mode        = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.expiration_time          = 600 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.hashclient_retry_attempts = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_dead_retry      = 300 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_password        = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_sasl_enabled    = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.memcache_username        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.proxies                  = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_db                 = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_password           = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_server             = localhost:6379 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_socket_timeout     = 1.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.redis_username           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.retry_attempts           = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.retry_delay              = 0.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.socket_keepalive_count   = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.socket_keepalive_idle    = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.socket_keepalive_interval = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.tls_allowed_ciphers      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.tls_cafile               = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.tls_certfile             = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.tls_enabled              = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cache.tls_keyfile              = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] coordination.backend_url       = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.asyncio_connection    = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.asyncio_slave_connection = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.backend               = sqlalchemy {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.connection            = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.connection_debug      = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.connection_parameters =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.connection_recycle_time = 3600 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.connection_trace      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.db_inc_retry_interval = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.db_max_retries        = 20 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.db_max_retry_interval = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.db_retry_interval     = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.max_overflow          = 50 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.max_pool_size         = 5 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.max_retries           = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.mysql_wsrep_sync_wait = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.pool_timeout          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.retry_interval        = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.slave_connection      = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.sqlite_synchronous    = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] database.use_db_reconnect      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.connection_string     = messaging:// {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.enabled               = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.es_doc_type           = notification {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.es_scroll_size        = 10000 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.es_scroll_time        = 2m {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.filter_error_trace    = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.hmac_keys             = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.sentinel_service_name = mymaster {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.socket_timeout        = 0.1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.trace_requests        = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler.trace_sqlalchemy      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler_jaeger.process_tags   = {} {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler_jaeger.service_name_prefix = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] profiler_otlp.service_name_prefix = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.enforce_new_defaults = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: WARNING oslo_config.cfg [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.enforce_scope      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.policy_default_rule = default {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.group          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.helper_command = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] privsep_osbrick.user           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.group         = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.helper_command = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] cinder_sys_admin.user          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.auth_section      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.auth_type         = password {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.certfile          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.collect_timing    = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.insecure          = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.keyfile           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.send_service_user_token = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.split_loggers     = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] service_user.timeout           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.backend_availability_zone = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.chap_password = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.chap_username =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_client_cert = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_client_cert_key = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_data_namespace = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.driver_use_ssl = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.extra_capabilities = {} {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.filter_function = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.goodness_function = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iscsi_target_flags =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iscsi_write_cache = on {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iser_helper   = tgtadm {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iser_ip_address = 192.168.122.70 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iser_port     = 3260 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.lvm_share_target = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.lvm_type      = auto {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.num_shell_tries = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.replication_device = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.report_discard_supported = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.reserved_percentage = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_helper = tgtadm {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_ip_address = 192.168.122.70 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_port   = 3260 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_protocol = iscsi {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.trace_flags   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.unique_fqdn_network = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.use_chap_auth = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_backend_name = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_clear  = zero {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_clear_ionice = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_clear_size = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_reports.file_event_handler = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_reports.log_dir           = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.backend_host       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.chap_password      = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.chap_username      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_client_cert = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.extra_capabilities = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.filter_function    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.goodness_function  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iscsi_iotype       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iser_helper        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iser_ip_address    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iser_port          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.lvm_share_target   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.lvm_type           = auto {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.num_shell_tries    = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.replication_device = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.report_discard_supported = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.reserved_percentage = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.scst_target_driver = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.storage_protocol   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_helper      = lioadm {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_ip_address  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_port        = 3260 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.trace_flags        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.use_chap_auth      = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_clear       = zero {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_clear_size  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.190s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] lvmdriver-1.volumes_dir        = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_notifications.driver = [] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_notifications.retry = -1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] key_manager.fixed_key          = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.barbican_api_version  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.barbican_endpoint     = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.barbican_endpoint_type = public {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.barbican_region_name  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.cafile                = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.certfile              = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.collect_timing        = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.insecure              = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.keyfile               = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.number_of_retries     = 60 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.retry_delay           = 1 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.send_service_user_token = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.split_loggers         = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.timeout               = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.verify_ssl            = True {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican.verify_ssl_path       = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.auth_section = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.auth_type = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.cafile   = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.certfile = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.collect_timing = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.insecure = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.keyfile  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.split_loggers = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] barbican_service_user.timeout  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.approle_role_id          = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.approle_secret_id        = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.kv_mountpoint            = secret {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.kv_path                  = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.kv_version               = 2 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.namespace                = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.root_token_id            = **** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.ssl_ca_crt_file          = None {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.timeout                  = 60.0 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.use_ssl                  = False {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 18:54:43 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] ******************************************************************************** {{(pid=74810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.100s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.089s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:43 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:43 devstack sudo[75011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 10 18:54:43 devstack sudo[75011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:45 devstack sudo[75011]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:45 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.085s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:45 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:45 devstack sudo[75131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:54:45 devstack sudo[75131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:47 devstack sudo[75131]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:47 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.995s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:47 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 18:54:47 devstack cinder-volume[74957]: INFO cinder.brick.local_dev.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 10 18:54:47 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:47 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.083s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:47 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:47 devstack sudo[75227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:54:47 devstack sudo[75227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:49 devstack sudo[75227]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:49 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.050s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:49 devstack cinder-volume[74957]: DEBUG cinder.brick.local_dev.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74957) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 10 18:54:49 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:50 devstack sudo[75328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:54:50 devstack sudo[75328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:52 devstack cinder-volume[74810]: DEBUG dbcounter [-] [74810] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74810) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:54:53 devstack sudo[75328]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:53 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.674s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:53 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:53 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.190s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:53 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:54 devstack sudo[75537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:54:54 devstack sudo[75537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:56 devstack sudo[75537]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:56 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.415s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:56 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:56 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.182s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:56 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:56 devstack sudo[75575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 10 18:54:56 devstack sudo[75575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:54:58 devstack sudo[75575]: pam_unix(sudo:session): session closed for user root
Sep 10 18:54:58 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.310s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:54:59 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:54:59 devstack sudo[75605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:54:59 devstack sudo[75605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:02 devstack sudo[75605]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:02 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.054s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:02 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:02 devstack sudo[75666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:55:02 devstack sudo[75666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:04 devstack sudo[75666]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:04 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.609s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:04 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:04 devstack sudo[75672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:04 devstack sudo[75672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:07 devstack sudo[75672]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:07 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.070s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:07 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:07 devstack sudo[75676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:08 devstack sudo[75676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:12 devstack sudo[75676]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:12 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.774s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:12 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:12 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.142s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:12 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:13 devstack sudo[75914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:13 devstack sudo[75914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:15 devstack sudo[75914]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:15 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.591s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:15 devstack cinder-volume[74957]: INFO cinder.volume.drivers.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 10 18:55:15 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:15 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.082s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:15 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:15 devstack sudo[76028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:15 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:17 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:17 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.189s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:17 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:55:17 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:17 devstack sudo[76167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:55:17 devstack sudo[76167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:19 devstack sudo[76167]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:19 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.014s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:19 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:19 devstack sudo[76171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:19 devstack sudo[76171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:21 devstack sudo[76171]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.165s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:22 devstack sudo[76174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:22 devstack sudo[76174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:24 devstack sudo[76174]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.076s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:24 devstack sudo[76179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:24 devstack sudo[76179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:25 devstack sudo[76179]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.946s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:26 devstack cinder-volume[74957]: INFO cinder.volume.driver [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG cinder.volume.driver [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74957) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74957) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writer thread running {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG cinder.db.sqlalchemy.api [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Building query based on filter {{(pid=74957) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG cinder.image.image_utils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74957) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 18:55:26 devstack cinder-volume[74957]: INFO cinder.keymgr.migration [None req-e623e490-88b9-481c-860f-df637b3392bb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:55:26 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:26 devstack sudo[76186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:55:26 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:29 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:29 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.056s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:29 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:29 devstack sudo[76308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:29 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:31 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:31 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.179s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:31 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:31 devstack sudo[76365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:31 devstack sudo[76365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:33 devstack sudo[76365]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:33 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.936s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:33 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:33 devstack sudo[76368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:33 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:35 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:35 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.854s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:35 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 18:55:35 devstack cinder-volume[74957]: INFO cinder.volume.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Driver initialization completed successfully.
Sep 10 18:55:35 devstack cinder-volume[74957]: INFO cinder.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Initiating service 2 cleanup
Sep 10 18:55:35 devstack cinder-volume[74957]: INFO cinder.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Service 2 cleanup completed.
Sep 10 18:55:35 devstack cinder-volume[74957]: DEBUG cinder.service [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Creating RPC server for service cinder-volume {{(pid=74957) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 18:55:35 devstack cinder-volume[74957]: DEBUG cinder.service [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74957) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 18:55:36 devstack cinder-volume[74957]: INFO cinder.volume.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 10 18:55:36 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:55:36 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:36 devstack sudo[76372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:55:36 devstack sudo[76372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:36 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:SELECT=2 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:55:38 devstack sudo[76372]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:38 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.084s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:38 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:38 devstack sudo[76387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:38 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:40 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:40 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.094s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:40 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:40 devstack sudo[76392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:55:40 devstack sudo[76392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:42 devstack sudo[76392]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:42 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.152s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:42 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:55:42 devstack sudo[76399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:55:42 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:55:44 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root
Sep 10 18:55:44 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.901s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:55:44 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:55:44 devstack cinder-volume[74957]: INFO cinder.volume.manager [None req-bf0c11de-bf87-4ffd-a3ac-bc55fbfaf993 None None] Driver post RPC initialization completed successfully.
Sep 10 18:55:54 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:UPDATE=1 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:56:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 18:56:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:56:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:56:21 devstack sudo[77330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:56:21 devstack sudo[77330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:56:24 devstack sudo[77330]: pam_unix(sudo:session): session closed for user root
Sep 10 18:56:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.548s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:56:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:56:24 devstack sudo[77336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:56:24 devstack sudo[77336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:56:26 devstack sudo[77336]: pam_unix(sudo:session): session closed for user root
Sep 10 18:56:26 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.124s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:56:26 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:56:26 devstack sudo[77340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:56:26 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:56:28 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root
Sep 10 18:56:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.048s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:56:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:56:28 devstack sudo[77343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:56:28 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:56:31 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root
Sep 10 18:56:31 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 3.523s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:56:31 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 18:57:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 18:57:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:57:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:57:21 devstack sudo[78029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:57:21 devstack sudo[78029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:57:23 devstack sudo[78029]: pam_unix(sudo:session): session closed for user root
Sep 10 18:57:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.965s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:57:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:57:23 devstack sudo[78032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:57:23 devstack sudo[78032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:57:25 devstack sudo[78032]: pam_unix(sudo:session): session closed for user root
Sep 10 18:57:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.967s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:57:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:57:25 devstack sudo[78076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:57:25 devstack sudo[78076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:57:27 devstack sudo[78076]: pam_unix(sudo:session): session closed for user root
Sep 10 18:57:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.406s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:57:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:57:28 devstack sudo[78080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:57:28 devstack sudo[78080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:57:30 devstack sudo[78080]: pam_unix(sudo:session): session closed for user root
Sep 10 18:57:30 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.983s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:57:30 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 18:57:54 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:58:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 18:58:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:58:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:58:21 devstack sudo[78974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:58:21 devstack sudo[78974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:58:23 devstack sudo[78974]: pam_unix(sudo:session): session closed for user root
Sep 10 18:58:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.120s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:58:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:58:23 devstack sudo[79121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:58:23 devstack sudo[79121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:58:25 devstack sudo[79121]: pam_unix(sudo:session): session closed for user root
Sep 10 18:58:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.170s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:58:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:58:26 devstack sudo[79285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:58:26 devstack sudo[79285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:58:28 devstack sudo[79285]: pam_unix(sudo:session): session closed for user root
Sep 10 18:58:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.446s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:58:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:58:28 devstack sudo[79447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:58:28 devstack sudo[79447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:58:30 devstack sudo[79447]: pam_unix(sudo:session): session closed for user root
Sep 10 18:58:30 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.021s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:58:30 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 18:59:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 18:59:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 18:59:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:59:21 devstack sudo[81316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 18:59:21 devstack sudo[81316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:59:23 devstack sudo[81316]: pam_unix(sudo:session): session closed for user root
Sep 10 18:59:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.054s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:59:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:59:23 devstack sudo[81328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:59:23 devstack sudo[81328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:59:25 devstack sudo[81328]: pam_unix(sudo:session): session closed for user root
Sep 10 18:59:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.064s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:59:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:59:26 devstack sudo[81337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 18:59:26 devstack sudo[81337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:59:28 devstack sudo[81337]: pam_unix(sudo:session): session closed for user root
Sep 10 18:59:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.227s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:59:28 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 18:59:28 devstack sudo[81352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 18:59:28 devstack sudo[81352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 18:59:29 devstack sudo[81352]: pam_unix(sudo:session): session closed for user root
Sep 10 18:59:29 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.830s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 18:59:29 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 18:59:54 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:SELECT=1 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 18:59:54 devstack cinder-volume[74957]: DEBUG dbcounter [-] [74957] Writing DB stats cinder:UPDATE=1 {{(pid=74957) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:00:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:00:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:00:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:00:21 devstack sudo[81606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:00:21 devstack sudo[81606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:00:23 devstack sudo[81606]: pam_unix(sudo:session): session closed for user root
Sep 10 19:00:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.930s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:00:23 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:00:23 devstack sudo[81609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:00:23 devstack sudo[81609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:00:25 devstack sudo[81609]: pam_unix(sudo:session): session closed for user root
Sep 10 19:00:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.229s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:00:25 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:00:25 devstack sudo[81614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:00:25 devstack sudo[81614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:00:27 devstack sudo[81614]: pam_unix(sudo:session): session closed for user root
Sep 10 19:00:27 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.011s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:00:27 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:00:27 devstack sudo[81617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:00:27 devstack sudo[81617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:00:29 devstack sudo[81617]: pam_unix(sudo:session): session closed for user root
Sep 10 19:00:29 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.815s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:00:29 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:01:21 devstack cinder-volume[74957]: DEBUG oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74957) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:01:21 devstack cinder-volume[74957]: DEBUG cinder.volume.drivers.lvm [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Updating volume stats {{(pid=74957) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 10 19:01:21 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:21 devstack sudo[82464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 10 19:01:21 devstack sudo[82464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:01:24 devstack sudo[82464]: pam_unix(sudo:session): session closed for user root
Sep 10 19:01:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.678s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:24 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:24 devstack sudo[82498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:01:24 devstack sudo[82498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:01:26 devstack sudo[82498]: pam_unix(sudo:session): session closed for user root
Sep 10 19:01:26 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.618s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:27 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:27 devstack sudo[82558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 10 19:01:27 devstack sudo[82558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:01:27 devstack cinder-volume[74810]: INFO oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Caught SIGTERM, stopping children
Sep 10 19:01:27 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Acquiring lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:01:27 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Acquired lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:01:27 devstack cinder-volume[74810]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Releasing lock "singleton_lock" {{(pid=74810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:01:27 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Stop services. {{(pid=74810) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 10 19:01:27 devstack cinder-volume[74810]: DEBUG oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Killing children. {{(pid=74810) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 10 19:01:27 devstack cinder-volume[74810]: INFO oslo_service.backend._eventlet.service [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Waiting on 1 children to exit
Sep 10 19:01:31 devstack sudo[82558]: pam_unix(sudo:session): session closed for user root
Sep 10 19:01:31 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 4.386s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:31 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:31 devstack sudo[82589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 10 19:01:31 devstack sudo[82589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:01:32 devstack cinder-volume[74957]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Sep 10 19:01:38 devstack sudo[82589]: pam_unix(sudo:session): session closed for user root
Sep 10 19:01:38 devstack cinder-volume[74957]: DEBUG oslo_concurrency.processutils [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 6.807s {{(pid=74957) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:38 devstack cinder-volume[74957]: DEBUG cinder.manager [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Notifying Schedulers of capabilities ... {{(pid=74957) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Unable to connect to AMQP server on 192.168.122.70:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task [None req-fbecdc98-7080-48e7-bafc-3097c4355ba6 None None] Error during VolumeManager.publish_service_capabilities: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.70:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1173, in ensure
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     ret, channel = autoretry_method()
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 556, in _ensured
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return fun(*args, **kwargs)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/connection.py", line 639, in __call__
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return fun(*args, channel=channels[0], **kwargs), channels[0]
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in execute_method
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     method()
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1624, in _publish
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self._producer.publish(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 190, in publish
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return _publish(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/kombu/messaging.py", line 214, in _publish
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return channel.basic_publish(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 99, in wait
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self.connection.drain_events(timeout=timeout)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 526, in drain_events
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     while not self.blocking_read(timeout):
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 532, in blocking_read
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return self.on_inbound_frame(frame)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/method_framing.py", line 53, in on_frame
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     callback(channel, method_sig, buf, None)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/connection.py", line 538, in on_inbound_method
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return self.channels[channel_id].dispatch_method(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     listener(*args)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/amqp/channel.py", line 293, in _on_close
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     raise error_for_code(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task 
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task During handling of the above exception, another exception occurred:
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task 
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task Traceback (most recent call last):
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py", line 216, in run_periodic_tasks
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     task(self, context)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/volume/manager.py", line 2873, in publish_service_capabilities
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self._publish_service_capabilities(context)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self.scheduler_rpcapi.update_service_capabilities(
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 154, in cast
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self.transport._send(self.target, msg_ctxt, msg,
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return self._driver.send(target, ctxt, message,
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     return self._send(target, ctxt, message, wait_for_reply, timeout,
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     conn.fanout_send(target.topic, msg, retry=retry)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1743, in fanout_send
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _ensure_publishing
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     self.ensure(method, retry=retry, error_callback=_error_callback)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1195, in ensure
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task     raise exceptions.MessageDeliveryFailure(msg)
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.70:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Sep 10 19:01:38 devstack cinder-volume[74957]: ERROR oslo_service.periodic_task 
Sep 10 19:01:41 devstack cinder-volume[74957]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Acquiring lock "singleton_lock" {{(pid=74957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:01:41 devstack cinder-volume[74957]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Acquired lock "singleton_lock" {{(pid=74957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:01:41 devstack cinder-volume[74957]: DEBUG oslo_concurrency.lockutils [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Releasing lock "singleton_lock" {{(pid=74957) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:01:41 devstack cinder-volume[74957]: WARNING amqp [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 19:01:41 devstack cinder-volume[74957]: WARNING amqp [None req-5794b381-7a8c-4d23-9ab4-eb48cab29c09 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 10 19:01:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82595) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 10 19:01:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82595) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 10 19:01:49 devstack cinder-volume[82595]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82595) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 10 19:01:53 devstack cinder-volume[82595]: INFO dbcounter [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Registered counter for database cinder
Sep 10 19:01:53 devstack cinder-volume[82595]: DEBUG oslo_db.sqlalchemy.engines [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:01:54 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writer thread running {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:01:54 devstack cinder-volume[82595]: INFO cinder.rpc [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 10 19:01:54 devstack cinder-volume[82595]: INFO cinder.rpc [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 10 19:01:54 devstack cinder-volume[82595]: DEBUG oslo_db.sqlalchemy.engines [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:01:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Determined volume DB was empty at startup.
Sep 10 19:01:54 devstack cinder-volume[82595]: DEBUG cinder.volume.manager [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82595) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 10 19:01:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 10 19:01:54 devstack cinder-volume[82595]: WARNING stevedore.named [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 10 19:01:54 devstack cinder-volume[82595]: WARNING castellan.key_manager [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:01:54 devstack cinder-volume[82595]: WARNING cinder.keymgr.conf_key_mgr [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 10 19:01:54 devstack cinder-volume[82595]: INFO cinder.volume.manager [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 10 19:01:54 devstack cinder-volume[82595]: DEBUG oslo_db.sqlalchemy.engines [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82595) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:01:55 devstack cinder-volume[82595]: INFO oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Starting 1 workers
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Started child 82863 {{(pid=82595) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Full set of CONF: {{(pid=82595) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] ******************************************************************************** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Configuration options gathered from: {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 10 19:01:55 devstack cinder-volume[82863]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] ================================================================================ {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] allow_availability_zone_fallback = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] allow_compression_on_image_upload = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] allowed_direct_url_schemes     = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] api_rate_limit                 = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] auth_strategy                  = keystone {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_availability_zone      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_host                   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_name                   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_stats_polling_interval = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backup_api_class               = cinder.backup.api.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backup_name_template           = backup-%s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backup_use_same_host           = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backup_use_temp_snapshot       = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] chap_password                  = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] chap_username                  =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_internal_tenant_project_id = d071b0578f0e4ccea733b34e8e45905d {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_internal_tenant_user_id = 0ea60d39a6e44e4bb378719a4aabe243 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cluster                        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] compression_format             = gzip {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] compute_api_class              = cinder.compute.nova.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] config_dir                     = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] config_source                  = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] control_exchange               = openstack {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] debug                          = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] default_availability_zone      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] default_group_type             = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] default_volume_type            = QuobyteHD {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_client_cert             = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_client_cert_key         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_data_namespace          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_ssl_cert_path           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_ssl_cert_verify         = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] driver_use_ssl                 = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] enable_new_services            = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] enable_unsupported_driver      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] enabled_backends               = ['QuobyteHD'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] enforce_multipath_for_image_xfer = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] filter_function                = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_api_insecure            = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_api_servers             = ['http://192.168.122.70/image'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_api_ssl_compression     = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_ca_certificates_file    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_catalog_info            = image:glance:publicURL {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_certfile                = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_keyfile                 = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_num_retries             = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] glance_request_timeout         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] goodness_function              = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] graceful_shutdown_timeout      = 5 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] group_api_class                = cinder.group.api.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] host                           = devstack {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_compress_on_upload       = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_conversion_address_space_limit = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_conversion_cpu_limit     = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_conversion_disable       = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_upload_use_cinder_backend = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_upload_use_internal_tenant = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_volume_cache_enabled     = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_volume_cache_max_count   = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] image_volume_cache_max_size_gb = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] init_host_max_objects_retrieval = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iscsi_iotype                   = fileio {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iscsi_target_flags             =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iscsi_write_cache              = on {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iser_helper                    = tgtadm {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iser_ip_address                = 192.168.122.70 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iser_port                      = 3260 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_color                      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_config_append              = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_dir                        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_file                       = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_options                    = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_rotate_interval            = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_rotate_interval_type       = days {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] log_rotation_type              = none {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] max_age                        = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] max_logfile_count              = 30 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] max_logfile_size_mb            = 200 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] max_over_subscription_ratio    = 20.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] message_reap_interval          = 86400 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] message_ttl                    = 2592000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] migration_create_volume_timeout_secs = 300 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] monkey_patch                   = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] monkey_patch_modules           = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] my_ip                          = 192.168.122.70 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] no_snapshot_gb_quota           = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] num_iser_scan_tries            = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] num_shell_tries                = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] num_volume_device_scan_tries   = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] nvmeof_conn_info_version       = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] nvmet_ns_id                    = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] nvmet_port_id                  = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_max_limit                = 1000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_ext_list          = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_listen_port       = 8776 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_use_ssl           = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] osapi_volume_workers           = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] per_volume_size_limit          = -1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] periodic_fuzzy_delay           = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] periodic_interval              = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] public_endpoint                = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] publish_errors                 = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_backup_gigabytes         = 1000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_backups                  = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_gigabytes                = 1000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_groups                   = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_snapshots                = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] quota_volumes                  = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] rate_limit_burst               = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] rate_limit_except_level        = CRITICAL {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] rate_limit_interval            = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] reinit_driver_count            = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] replication_device             = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] report_discard_supported       = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] report_interval                = 120 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 10 19:01:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82863) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] reservation_clean_interval     = 86400 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] reservation_expire             = 86400 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] reserved_image_namespaces      = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] reserved_percentage            = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] rpc_response_timeout           = 120 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] run_external_periodic_tasks    = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] scst_target_driver             = iscsi {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] scst_target_iqn_name           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_down_time              = 720 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] shell_completion               = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] snapshot_name_template         = snapshot-%s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] split_loggers                  = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] state_path                     = /opt/stack/data/cinder {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] storage_availability_zone      = nova {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] storage_protocol               = iSCSI {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] syslog_log_facility            = LOG_USER {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_helper                  = lioadm {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_ip_address              = 192.168.122.70 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_port                    = 3260 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_protocol                = iscsi {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] target_secondary_ip_addresses  = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] trace_flags                    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] transport_url                  = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] until_refresh                  = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_chap_auth                  = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_default_quota_class        = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_journal                    = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_json                       = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_multipath_for_image_xfer   = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_stderr                     = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] use_syslog                     = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] verify_glance_signatures       = enabled {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_api_class               = cinder.volume.api.API {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_backend_name            = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_clear                   = zero {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_clear_ionice            = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_clear_size              = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_copy_bps_limit          = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_dd_blocksize            = 1M {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_name_template           = volume-%s {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_service_inithost_offload = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volume_usage_audit_period      = month {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] watch_log_file                 = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] zoning_mode                    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_concurrency.disable_process_locking = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.admin_password = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.admin_token = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.admin_user  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:55 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_port   = 35357 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_protocol = https {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_section = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_type   = password {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_uri    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.auth_version = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.cache       = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.certfile    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.identity_uri = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.include_service_catalog = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.insecure    = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.interface   = public {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.keyfile     = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_password =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcache_username =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.region_name = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.service_type = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.backend                  = dogpile.cache.null {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.backend_argument         = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.backend_expiration_time  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.config_prefix            = cache.oslo {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.dead_timeout             = 60.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.debug_cache_backend      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.enable_retry_client      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.enable_socket_keepalive  = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.enabled                  = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.enforce_fips_mode        = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.expiration_time          = 600 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.hashclient_retry_attempts = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_dead_retry      = 300 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_password        = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_sasl_enabled    = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.memcache_username        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.proxies                  = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_db                 = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_password           = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_server             = localhost:6379 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_socket_timeout     = 1.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.redis_username           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.retry_attempts           = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.retry_delay              = 0.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.socket_keepalive_count   = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.socket_keepalive_idle    = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.socket_keepalive_interval = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.tls_allowed_ciphers      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.tls_cafile               = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.tls_certfile             = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.tls_enabled              = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cache.tls_keyfile              = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] coordination.backend_url       = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.asyncio_connection    = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.asyncio_slave_connection = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.backend               = sqlalchemy {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.connection            = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.connection_debug      = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.connection_parameters =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.connection_recycle_time = 3600 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.connection_trace      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.db_inc_retry_interval = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.db_max_retries        = 20 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.db_max_retry_interval = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.db_retry_interval     = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.max_overflow          = 50 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.max_pool_size         = 5 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.max_retries           = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.mysql_wsrep_sync_wait = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.pool_timeout          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.retry_interval        = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.slave_connection      = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.sqlite_synchronous    = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] database.use_db_reconnect      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.connection_string     = messaging:// {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.enabled               = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.es_doc_type           = notification {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.es_scroll_size        = 10000 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.es_scroll_time        = 2m {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.filter_error_trace    = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.hmac_keys             = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.sentinel_service_name = mymaster {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.socket_timeout        = 0.1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.trace_requests        = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler.trace_sqlalchemy      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler_jaeger.process_tags   = {} {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler_jaeger.service_name_prefix = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] profiler_otlp.service_name_prefix = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.enforce_new_defaults = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: WARNING oslo_config.cfg [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.enforce_scope      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.policy_default_rule = default {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.group          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.helper_command = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] privsep_osbrick.user           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.group         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.helper_command = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] cinder_sys_admin.user          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.auth_section      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.auth_type         = password {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.certfile          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.collect_timing    = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.insecure          = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.keyfile           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.send_service_user_token = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.split_loggers     = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] service_user.timeout           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.backend_availability_zone = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.chap_password = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.chap_username =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_client_cert = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_client_cert_key = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_data_namespace = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.driver_use_ssl = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.extra_capabilities = {} {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.filter_function = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.goodness_function = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iscsi_target_flags =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iscsi_write_cache = on {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iser_helper   = tgtadm {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iser_ip_address = 192.168.122.70 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iser_port     = 3260 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_host      =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_login     = admin {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_mount_options = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_password  = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_private_key =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_share_path =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.num_shell_tries = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.quobyte_volume_url = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.replication_device = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.report_discard_supported = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.reserved_percentage = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_helper = tgtadm {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_ip_address = 192.168.122.70 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_port   = 3260 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_protocol = iscsi {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.trace_flags   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.unique_fqdn_network = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.use_chap_auth = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_backend_name = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_clear  = zero {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_clear_ionice = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_clear_size = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_reports.file_event_handler = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_reports.log_dir           = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.backend_availability_zone = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.backend_host         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.chap_password        = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.chap_username        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.chiscsi_conf         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_client_cert   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_data_namespace = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.driver_use_ssl       = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.extra_capabilities   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.filter_function      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.goodness_function    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iscsi_iotype         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iser_helper          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iser_ip_address      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iser_port            = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.iser_target_prefix   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_host             = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_login            = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_mount_options    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_password         = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_private_key      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_share_path       = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_ssh_port         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.num_shell_tries      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.nvmet_port_id        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.replication_device   = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.report_discard_supported = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.reserved_percentage  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.scst_target_driver   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.storage_protocol     = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_helper        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_ip_address    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_port          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_prefix        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_protocol      = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.trace_flags          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.use_chap_auth        = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_clear         = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_clear_size    = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] QuobyteHD.volumes_dir          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_notifications.driver = [] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_notifications.retry = -1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] key_manager.fixed_key          = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.barbican_api_version  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.barbican_endpoint     = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.barbican_endpoint_type = public {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.barbican_region_name  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.cafile                = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.certfile              = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.collect_timing        = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.insecure              = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.keyfile               = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.number_of_retries     = 60 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.retry_delay           = 1 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.send_service_user_token = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.split_loggers         = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.timeout               = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.verify_ssl            = True {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican.verify_ssl_path       = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.auth_section = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.auth_type = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.cafile   = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.certfile = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.collect_timing = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.insecure = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.keyfile  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.split_loggers = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] barbican_service_user.timeout  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.approle_role_id          = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.approle_secret_id        = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.kv_mountpoint            = secret {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.kv_path                  = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.kv_version               = 2 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.namespace                = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.root_token_id            = **** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.ssl_ca_crt_file          = None {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.timeout                  = 60.0 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.use_ssl                  = False {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 10 19:01:56 devstack cinder-volume[82595]: DEBUG oslo_service.backend._eventlet.service [None req-c91d1968-270d-4270-b7dd-ded6c692a2e5 None None] ******************************************************************************** {{(pid=82595) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 10 19:01:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82863) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 10 19:01:56 devstack cinder-volume[82863]: INFO cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 10 19:01:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Running cmd (subprocess): mount.quobyte {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:57 devstack quobyte-client[82879]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 19:01:57 devstack quobyte-client[82879]: Invalid parameters found, error: missing mount point.
Sep 10 19:01:57 devstack quobyte-client[82879]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 10 19:01:57 devstack quobyte-client[82879]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 10 19:01:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] CMD "mount.quobyte" returned: 1 in 0.874s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:01:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:01:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:01:57 devstack cinder-volume[82863]: INFO cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Mounting volume: 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 ...
Sep 10 19:01:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 -c /etc/quobyte/client-cinder.cfg {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:58 devstack quobyte-client[82891]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 10 19:01:58 devstack quobyte-client[82891]: Reading configuration file: /etc/quobyte/client.cfg
Sep 10 19:01:58 devstack quobyte-client[82891]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789' to display the log.
Sep 10 19:01:58 devstack quobyte-client[82905]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 10 19:01:58 devstack quobyte-client[82905]: mount.quobyte 3.25 (4fbbd59204)
Sep 10 19:01:58 devstack quobyte-client[82905]: Client UUID: NrRcY8oR-Ph7t-TVNG-Ztgb-cPItDvJ6c7HW
Sep 10 19:01:58 devstack quobyte-client[82905]: Registry: osci01.corp.quobyte.com:7861
Sep 10 19:01:58 devstack quobyte-client[82905]: Volume: cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:01:58 devstack quobyte-client[82905]: FUSE version: 316
Sep 10 19:01:58 devstack quobyte-client[82905]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 10 19:01:58 devstack quobyte-client[82905]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 10 19:01:58 devstack quobyte-client[82905]: Setting total object cache size to 3352297472 bytes
Sep 10 19:01:58 devstack quobyte-client[82905]: Using FUSE low-level API
Sep 10 19:01:58 devstack quobyte-client[82905]: Caching of uid/gid to user/group name mappings is enabled
Sep 10 19:01:58 devstack quobyte-client[82905]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 10 19:01:58 devstack quobyte-client[82905]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 10 19:01:58 devstack quobyte-client[82905]: HTTP server started on port 55000
Sep 10 19:01:58 devstack quobyte-client[82905]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 10 19:01:58 devstack quobyte-client[82905]: Mount point /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 established
Sep 10 19:01:58 devstack quobyte-client[82905]: TimeSync is running and remote sync every 60 seconds
Sep 10 19:01:58 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:01:58 devstack quobyte-client[82905]: Ignored time synchronization message because time source took too long to respond (88 ms)
Sep 10 19:01:58 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:01:58 devstack quobyte-client[82905]: Opening volume cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 (b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1)
Sep 10 19:01:58 devstack quobyte-client[82905]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 10 19:01:58 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:01:58 devstack quobyte-client[82905]: Failed to invalidate inode: 38: Function not implemented
Sep 10 19:01:58 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:01:58 devstack quobyte-client[82905]: Automatic minidump upload enabled by global system configuration
Sep 10 19:01:58 devstack quobyte-client[82905]: Announcing HTTP status server address 172.24.4.1
Sep 10 19:01:58 devstack quobyte-client[82905]: Registered as service (uuid NrRcY8oR-Ph7t-TVNG-Ztgb-cPItDvJ6c7HW)
Sep 10 19:01:58 devstack quobyte-client[82905]: Quobyte Client running as pid 82905
Sep 10 19:01:58 devstack quobyte-client[82905]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 10 19:01:58 devstack quobyte-client[82905]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.083s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:58 devstack cinder-volume[82863]: INFO cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Mounting volume: 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 succeeded
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.169s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:58 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:58 devstack cinder-volume[82863]: INFO cinder.volume.driver [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Driver hasn't implemented _init_vendor_properties()
Sep 10 19:01:58 devstack cinder-volume[82863]: DEBUG cinder.volume.driver [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82863) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_db.sqlalchemy.engines [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82863) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writer thread running {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG cinder.db.sqlalchemy.api [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Building query based on filter {{(pid=82863) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82863) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 10 19:01:59 devstack cinder-volume[82863]: INFO cinder.keymgr.migration [None req-aa7b65d3-6a8a-448d-864c-804a3a26aeca None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.086s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:01:59 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:01:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Driver initialization completed successfully.
Sep 10 19:01:59 devstack cinder-volume[82863]: INFO cinder.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Initiating service 3 cleanup
Sep 10 19:02:00 devstack cinder-volume[82863]: INFO cinder.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Service 3 cleanup completed.
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG cinder.service [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Creating RPC server for service cinder-volume {{(pid=82863) start /opt/stack/cinder/cinder/service.py:239}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG cinder.service [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82863) start /opt/stack/cinder/cinder/service.py:245}}
Sep 10 19:02:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 10 19:02:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:02:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:02:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.097s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:02:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f56e406-21fc-460a-a8c1-aa441f063311 None None] Driver post RPC initialization completed successfully.
Sep 10 19:02:01 devstack quobyte-client[82905]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 10 19:02:05 devstack cinder-volume[82595]: DEBUG dbcounter [-] [82595] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82595) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:02:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:02:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:03:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:03:18 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Flow 'volume_create_manager' (070815ca-643f-409a-aa89-910e3508e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578d7f96-c46b-4c28-8799-8723ada0cac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578d7f96-c46b-4c28-8799-8723ada0cac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-113920522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c6c73d-a500-4bce-be6d-6373e5c931c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf5dbb1acd4ce88825e7637f35dd47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:03:18Z,use_quota=True,user_id='140033e0fb4c406eae81382844b0ef92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e42e862-08df-4431-9516-130a8bb02662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e42e862-08df-4431-9516-130a8bb02662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2dc0f7-126f-4dd5-8fe5-107763661555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2dc0f7-126f-4dd5-8fe5-107763661555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2c6c73d-a500-4bce-be6d-6373e5c931c7', 'volume_name': 'volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343201ae-f5c4-466f-b659-75819106fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343201ae-f5c4-466f-b659-75819106fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2c0f76-af78-44fc-9138-e494ba03cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:19 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume d2c6c73d-a500-4bce-be6d-6373e5c931c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7', 'volume_size': 1}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-113920522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2c6c73d-a500-4bce-be6d-6373e5c931c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf5dbb1acd4ce88825e7637f35dd47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:03:18Z,use_quota=True,user_id='140033e0fb4c406eae81382844b0ef92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Creating volume d2c6c73d-a500-4bce-be6d-6373e5c931c7 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:03:19 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:03:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:03:19 devstack quobyte-client[82905]: System call of process 83138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:03:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=2, name=volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:03:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 1073741824" returned: 0 in 1.169s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:03:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:03:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7" returned: 0 in 0.113s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:03:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] <== create_volume: return (1405ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:03:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:03:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2c0f76-af78-44fc-9138-e494ba03cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b612c0f-051e-47bc-9e00-8d774a6ce15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:03:21 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 (d2c6c73d-a500-4bce-be6d-6373e5c931c7): created successfully
Sep 10 19:03:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b612c0f-051e-47bc-9e00-8d774a6ce15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:03:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Flow 'volume_create_manager' (070815ca-643f-409a-aa89-910e3508e720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:03:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b2abd9a0-f45b-4081-b2c4-44a0a5fe04c6 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Created volume successfully.
Sep 10 19:03:31 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:03:31 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.119s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:03:36 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:04:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:04:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:04:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:04:18 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:04:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Flow 'volume_create_manager' (aca8660d-76fe-4eb9-9e30-fdb1bdf23393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:04:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e0c712-a950-44eb-8fb3-463abc61aa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e0c712-a950-44eb-8fb3-463abc61aa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-51289252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300d1175-478d-4980-966c-797022521bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0725ca4e583c4a168cf6b71163fe6d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:04:18Z,use_quota=True,user_id='1bb633a6e20f46ab8e4e9e3a2466aab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e1c87-f2ec-4dd6-acc1-6968d30991d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6e1c87-f2ec-4dd6-acc1-6968d30991d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b794c4d-9ac9-4ebf-a07c-3f1d9553fc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b794c4d-9ac9-4ebf-a07c-3f1d9553fc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '300d1175-478d-4980-966c-797022521bf4', 'volume_name': 'volume-300d1175-478d-4980-966c-797022521bf4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363581e-c4c1-4708-a1e1-29f80805ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2363581e-c4c1-4708-a1e1-29f80805ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693ed211-c86e-4fcc-ab6e-5bae42af64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:19 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Volume 300d1175-478d-4980-966c-797022521bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-300d1175-478d-4980-966c-797022521bf4', 'volume_size': 1}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-51289252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=300d1175-478d-4980-966c-797022521bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0725ca4e583c4a168cf6b71163fe6d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:04:18Z,use_quota=True,user_id='1bb633a6e20f46ab8e4e9e3a2466aab2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Creating volume 300d1175-478d-4980-966c-797022521bf4 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:04:19 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:04:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=3, name=volume-300d1175-478d-4980-966c-797022521bf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:04:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4 1073741824" returned: 0 in 1.657s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4" returned: 0 in 0.365s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] <== create_volume: return (2337ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:04:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:04:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693ed211-c86e-4fcc-ab6e-5bae42af64b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-300d1175-478d-4980-966c-797022521bf4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dfe92d-0d97-400c-a21c-ed37ec9cd445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:04:23 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Volume volume-300d1175-478d-4980-966c-797022521bf4 (300d1175-478d-4980-966c-797022521bf4): created successfully
Sep 10 19:04:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dfe92d-0d97-400c-a21c-ed37ec9cd445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:04:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Flow 'volume_create_manager' (aca8660d-76fe-4eb9-9e30-fdb1bdf23393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:04:23 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3634632c-c4c2-48c7-b1b8-08a9784bebb8 tempest-VolumesAdminNegativeTest-1794087931 None] Created volume successfully.
Sep 10 19:04:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Acquiring lock "cinder-300d1175-478d-4980-966c-797022521bf4-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:04:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "cinder-300d1175-478d-4980-966c-797022521bf4-delete_volume" acquired by "delete_volume" :: waited 0.204s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:04:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:04:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Acquiring lock "cinder-quobyte-300d1175-478d-4980-966c-797022521bf4" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:04:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "cinder-quobyte-300d1175-478d-4980-966c-797022521bf4" acquired by "delete_volume" :: waited 0.038s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:04:27 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5w7vony7/privsep.sock']
Sep 10 19:04:27 devstack sudo[83832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5w7vony7/privsep.sock
Sep 10 19:04:27 devstack sudo[83832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:04:33 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:04:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:37 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:04:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.915s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:04:44 devstack sudo[83832]: pam_unix(sudo:session): session closed for user root
Sep 10 19:04:44 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Spawned new privsep daemon via rootwrap
Sep 10 19:04:44 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Accepted privsep connection to /tmp/tmp5w7vony7/privsep.sock {{(pid=82863) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 10 19:04:44 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 10 19:04:44 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 10 19:04:44 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 10 19:04:44 devstack cinder-volume[82863]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83876
Sep 10 19:04:44 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f75ec5-8b76-40dd-b111-1d754710ba1d]: (2,) {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:04:44 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15f700f-a650-4df5-82aa-41ab659f5fee]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:04:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:45 devstack quobyte-client[82905]: System call of process 83945 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:04:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4" returned: 0 in 1.446s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-300d1175-478d-4980-966c-797022521bf4" returned: 0 in 0.373s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "cinder-quobyte-300d1175-478d-4980-966c-797022521bf4" released by "delete_volume" :: held 19.664s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:04:47 devstack cinder-volume[82863]: WARNING cinder.quota [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:04:47 devstack cinder-volume[82863]: WARNING cinder.quota [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Created reservations ['ce2c1f86-328a-4ec7-b773-97f67a610605', '286e3c19-5b77-44ca-b883-0295475b501e', '626c61e9-f777-484b-b1b5-d4f1021547aa', '7fe8f93f-1f00-4faa-aa10-822b7f55fafb'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:04:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:04:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.293s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:04:49 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:04:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Deleted volume successfully.
Sep 10 19:04:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98cf833e-c155-439a-8e8a-dfd692e3bbbc tempest-VolumesAdminNegativeTest-1794087931 None] Lock "cinder-300d1175-478d-4980-966c-797022521bf4-delete_volume" released by "delete_volume" :: held 23.912s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:04:58 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=3,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:05:00 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.177s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:05:36 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:05:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Flow 'volume_create_manager' (e7f0845a-5a8c-40ae-b0fd-31b7f05c8721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131de197-e541-422c-9e77-90d922136c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131de197-e541-422c-9e77-90d922136c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1598035080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65c8dcc-de45-40e5-9ab9-5fb893eff6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d388f8b4424cc2901345da8549995d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:05:40Z,use_quota=True,user_id='da0a0a4b20404ea5aead71013e5276e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3e8c9-95b5-490a-a9b2-7f1953add86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3e8c9-95b5-490a-a9b2-7f1953add86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abda0474-c783-4c1d-9815-6164b25849eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abda0474-c783-4c1d-9815-6164b25849eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd65c8dcc-de45-40e5-9ab9-5fb893eff6bd', 'volume_name': 'volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a1f146-a234-456d-9d62-08f1d06b0e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a1f146-a234-456d-9d62-08f1d06b0e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd36884b-9512-4805-badc-52b51637cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume d65c8dcc-de45-40e5-9ab9-5fb893eff6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd', 'volume_size': 1}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1598035080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65c8dcc-de45-40e5-9ab9-5fb893eff6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d388f8b4424cc2901345da8549995d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:05:40Z,use_quota=True,user_id='da0a0a4b20404ea5aead71013e5276e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Creating volume d65c8dcc-de45-40e5-9ab9-5fb893eff6bd {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:05:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:05:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:05:41 devstack quobyte-client[82905]: System call of process 84205 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:05:41 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=4, name=volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:05:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd 1073741824" returned: 0 in 0.601s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:05:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:05:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" returned: 0 in 0.341s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] <== create_volume: return (1068ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd36884b-9512-4805-badc-52b51637cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd33e78-6249-4a0f-9bb0-e98c29863bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:05:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd (d65c8dcc-de45-40e5-9ab9-5fb893eff6bd): created successfully
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dd33e78-6249-4a0f-9bb0-e98c29863bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:05:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Flow 'volume_create_manager' (e7f0845a-5a8c-40ae-b0fd-31b7f05c8721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:05:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5398453c-c17a-46cc-88ee-84d817f65512 tempest-AttachSCSIVolumeTestJSON-729811936 None] Created volume successfully.
Sep 10 19:05:52 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:05:52 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:05:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:05:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:05:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e92d69e-7ecc-404b-929f-1622a599c195]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:05:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7" returned: 0 in 0.452s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.505s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.440s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69330bd2-d326-4cee-851e-39827d344fca]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:05:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:05:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f31a14dc-14db-4d19-9b94-a1070dbe0104', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:05:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:05:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" returned: 0 in 0.705s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:05:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:05:58 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-fc77e55e-7973-43ad-84fa-39a3a5116a49 req-4450bee7-a0ae-4787-bb9e-ca8e0295a9ea tempest-VolumesAssistedSnapshotsTest-1030056409 None] attachment_update completed successfully.
Sep 10 19:05:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bebb57f-7765-4f46-8a01-48deeb01ae9b', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:05:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:05:58 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-893f1eef-eabe-4c20-9bf8-c127a52862d0 req-31b68d42-04dd-4f55-bce1-1beb6738aaf8 tempest-AttachSCSIVolumeTestJSON-729811936 None] attachment_update completed successfully.
Sep 10 19:06:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Flow 'volume_create_manager' (f76a32ec-1adf-4381-97a3-25b3bab1349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b848691f-83e7-4167-8073-ff8f864c0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b848691f-83e7-4167-8073-ff8f864c0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-754687255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af347af-0415-4929-bbc4-6d415dc7663c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f431a2e2720c4993bf5abab786e07b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:06:12Z,use_quota=True,user_id='4d420228fb56416f9c81a1984a5bc1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edff7dc4-4402-45d7-a503-2f54ae436318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edff7dc4-4402-45d7-a503-2f54ae436318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94297bc4-ed36-4332-9738-4c564e0c215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94297bc4-ed36-4332-9738-4c564e0c215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af347af-0415-4929-bbc4-6d415dc7663c', 'volume_name': 'volume-4af347af-0415-4929-bbc4-6d415dc7663c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea4326-2e8f-47fe-9c96-0f680d9244ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea4326-2e8f-47fe-9c96-0f680d9244ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6592c6f-3dcc-430b-a830-ec1afafd752e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Volume 4af347af-0415-4929-bbc4-6d415dc7663c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af347af-0415-4929-bbc4-6d415dc7663c', 'volume_size': 1}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-754687255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af347af-0415-4929-bbc4-6d415dc7663c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f431a2e2720c4993bf5abab786e07b0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:06:12Z,use_quota=True,user_id='4d420228fb56416f9c81a1984a5bc1fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Creating volume 4af347af-0415-4929-bbc4-6d415dc7663c {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:06:12 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:12 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=5, name=volume-4af347af-0415-4929-bbc4-6d415dc7663c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c 1073741824" returned: 0 in 0.343s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c" returned: 0 in 0.066s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.475s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6592c6f-3dcc-430b-a830-ec1afafd752e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af347af-0415-4929-bbc4-6d415dc7663c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c7750-fa84-4d8e-9fea-03bc5d4ad4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:06:12 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Volume volume-4af347af-0415-4929-bbc4-6d415dc7663c (4af347af-0415-4929-bbc4-6d415dc7663c): created successfully
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4c7750-fa84-4d8e-9fea-03bc5d4ad4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:06:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Flow 'volume_create_manager' (f76a32ec-1adf-4381-97a3-25b3bab1349c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:06:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9217f8b0-622e-4932-b03b-b0e86a6b37af tempest-TaggedAttachmentsTest-1840024558 None] Created volume successfully.
Sep 10 19:06:22 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-c197cb3a-2a0b-40dc-bb11-140f285351a7 req-59331c6b-3723-4d56-ab0c-3c68b56e5ff9 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-c197cb3a-2a0b-40dc-bb11-140f285351a7 req-59331c6b-3723-4d56-ab0c-3c68b56e5ff9 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-c197cb3a-2a0b-40dc-bb11-140f285351a7 req-59331c6b-3723-4d56-ab0c-3c68b56e5ff9 tempest-AttachSCSIVolumeTestJSON-729811936 None] Terminate volume connection completed successfully.
Sep 10 19:06:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-c197cb3a-2a0b-40dc-bb11-140f285351a7 req-59331c6b-3723-4d56-ab0c-3c68b56e5ff9 tempest-AttachSCSIVolumeTestJSON-729811936 None] Deleting attachment 3bebb57f-7765-4f46-8a01-48deeb01ae9b. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:06:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-73859355-afa5-4246-8d95-9b6581586fa1 req-189b4146-e015-4042-8a5a-d54432133901 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:29 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-73859355-afa5-4246-8d95-9b6581586fa1 req-189b4146-e015-4042-8a5a-d54432133901 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-73859355-afa5-4246-8d95-9b6581586fa1 req-189b4146-e015-4042-8a5a-d54432133901 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Terminate volume connection completed successfully.
Sep 10 19:06:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-73859355-afa5-4246-8d95-9b6581586fa1 req-189b4146-e015-4042-8a5a-d54432133901 tempest-VolumesAssistedSnapshotsTest-1030056409 None] Deleting attachment f31a14dc-14db-4d19-9b94-a1070dbe0104. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:06:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "cinder-d2c6c73d-a500-4bce-be6d-6373e5c931c7-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:06:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "cinder-d2c6c73d-a500-4bce-be6d-6373e5c931c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:06:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "cinder-quobyte-d2c6c73d-a500-4bce-be6d-6373e5c931c7" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:06:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "cinder-quobyte-d2c6c73d-a500-4bce-be6d-6373e5c931c7" acquired by "delete_volume" :: waited 0.087s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:06:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0b14de-92e1-4dc0-a833-eb406fc35b0b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:06:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7" returned: 0 in 1.708s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d2c6c73d-a500-4bce-be6d-6373e5c931c7" returned: 0 in 0.140s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "cinder-quobyte-d2c6c73d-a500-4bce-be6d-6373e5c931c7" released by "delete_volume" :: held 2.226s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Created reservations ['4ce51232-ab04-4ce6-ad4c-49de486ca066', '47cfbb07-3bdb-4037-887e-6ad7ee59fa1b', '426c77ee-5032-4cd9-a642-143b6f436608', '9040525a-ff0c-46ed-a113-538e0849456e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.258s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:34 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:06:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Deleted volume successfully.
Sep 10 19:06:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d92340ee-89a2-42f7-9c18-cb92a8dfa6bf tempest-VolumesAssistedSnapshotsTest-1030056409 None] Lock "cinder-d2c6c73d-a500-4bce-be6d-6373e5c931c7-delete_volume" released by "delete_volume" :: held 4.406s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:06:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.408s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:06:44 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "cinder-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "cinder-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:06:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "cinder-quobyte-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "cinder-quobyte-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2673a23e-29be-42b0-840d-91efefcea1d8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:06:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:55 devstack quobyte-client[82905]: System call of process 84979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:06:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" returned: 0 in 0.815s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" returned: 0 in 0.134s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "cinder-quobyte-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd" released by "delete_volume" :: held 1.112s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Created reservations ['b4c3a457-88e1-4c13-92a4-e3477a30b078', 'ec419dbe-a9bd-403c-8f5c-6de9bb4f48d4', '56072ade-cb34-4e40-8311-1f2b43ee593c', 'cc723682-4e0d-47d2-922e-1453cbb83279'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.161s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:06:56 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:06:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Deleted volume successfully.
Sep 10 19:06:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d5016f01-5a43-44e5-9def-91259f450435 tempest-AttachSCSIVolumeTestJSON-729811936 None] Lock "cinder-d65c8dcc-de45-40e5-9ab9-5fb893eff6bd-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:07:06 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=5 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:07:06 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.070s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:07:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.207s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:07:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:08:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Flow 'volume_create_manager' (451c5ec7-c401-4b20-8aec-d7fb702a4ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5a564-993f-4611-b909-99ea371f67d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5a564-993f-4611-b909-99ea371f67d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1938775501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99318a-2db7-4cdc-acd8-2cfd63ead36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c219016a482841a0ab5ed0b2b71a51ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:08:19Z,use_quota=True,user_id='ef2a59ad819641bbab82d648ff450874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a931a2d-b9bd-40d8-876d-6cbc3ffdb81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a931a2d-b9bd-40d8-876d-6cbc3ffdb81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b21b2c3-453a-4f0a-875b-915639da5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b21b2c3-453a-4f0a-875b-915639da5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a99318a-2db7-4cdc-acd8-2cfd63ead36b', 'volume_name': 'volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c724bd3-f677-4b32-ad3b-895ec256f8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c724bd3-f677-4b32-ad3b-895ec256f8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b75539-7739-4ff0-83a6-7ca264187478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:19 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Volume 3a99318a-2db7-4cdc-acd8-2cfd63ead36b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b', 'volume_size': 1}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1938775501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a99318a-2db7-4cdc-acd8-2cfd63ead36b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c219016a482841a0ab5ed0b2b71a51ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:08:19Z,use_quota=True,user_id='ef2a59ad819641bbab82d648ff450874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:08:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Creating volume 3a99318a-2db7-4cdc-acd8-2cfd63ead36b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.128s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:08:20 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:08:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=6, name=volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:08:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b 1073741824" returned: 0 in 1.682s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" returned: 0 in 0.347s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] <== create_volume: return (2375ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:08:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:08:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b75539-7739-4ff0-83a6-7ca264187478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe1b0b0-a046-4a24-b45a-4a89e8458bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:08:23 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Volume volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b (3a99318a-2db7-4cdc-acd8-2cfd63ead36b): created successfully
Sep 10 19:08:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe1b0b0-a046-4a24-b45a-4a89e8458bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:08:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Flow 'volume_create_manager' (451c5ec7-c401-4b20-8aec-d7fb702a4ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:08:23 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f4f3ff17-18b3-4e85-b4d0-bb9a1c8733eb tempest-DeleteServersTestJSON-1338528517 None] Created volume successfully.
Sep 10 19:08:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:08:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:08:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[03259ccc-fdbb-4504-9f47-2fd8bc99fedb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:08:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c" returned: 0 in 1.316s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.502s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:08:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-4af347af-0415-4929-bbc4-6d415dc7663c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f69b2d9c-66ff-434c-8b59-cf9fd0203649', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:08:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:08:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-4f6d263a-3ffd-4245-9d8f-195ee372711f req-5843c9aa-82ce-43b4-a735-445ebf3b0e9a tempest-TaggedAttachmentsTest-1840024558 None] attachment_update completed successfully.
Sep 10 19:08:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:08:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:08:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0adba3d-5b2d-4313-9c6b-43616c1e59a0]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:08:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" returned: 0 in 1.328s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.602s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cde7b2df-3597-4d6b-a44c-a57671b71207', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:08:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.089s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:08:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:08:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.634s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:08:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-5bf62fe3-c50d-4cce-9448-db5af6f1c37c req-47932484-e81a-4b57-99a3-9f72e4323997 tempest-DeleteServersTestJSON-1338528517 None] attachment_update completed successfully.
Sep 10 19:08:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:08:48 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:08:48 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=3,cinder:SELECT=14,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:09:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-49c3c42d-6860-4442-82d4-6460fd82f3b6 req-87efcf58-52a5-4acb-9310-87cb99e4182f tempest-DeleteServersTestJSON-1338528517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-49c3c42d-6860-4442-82d4-6460fd82f3b6 req-87efcf58-52a5-4acb-9310-87cb99e4182f tempest-DeleteServersTestJSON-1338528517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-49c3c42d-6860-4442-82d4-6460fd82f3b6 req-87efcf58-52a5-4acb-9310-87cb99e4182f tempest-DeleteServersTestJSON-1338528517 None] Terminate volume connection completed successfully.
Sep 10 19:09:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-49c3c42d-6860-4442-82d4-6460fd82f3b6 req-87efcf58-52a5-4acb-9310-87cb99e4182f tempest-DeleteServersTestJSON-1338528517 None] Deleting attachment cde7b2df-3597-4d6b-a44c-a57671b71207. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "cinder-3a99318a-2db7-4cdc-acd8-2cfd63ead36b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "cinder-3a99318a-2db7-4cdc-acd8-2cfd63ead36b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "cinder-quobyte-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "cinder-quobyte-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb6198-bbe2-4a32-8145-568aa4001dff]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:09:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-7c7fa8e9-08d6-4ba6-8cdc-6b29b2e43284 req-80437481-a4b6-4820-a918-99c7d9933abd tempest-TaggedAttachmentsTest-1840024558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-7c7fa8e9-08d6-4ba6-8cdc-6b29b2e43284 req-80437481-a4b6-4820-a918-99c7d9933abd tempest-TaggedAttachmentsTest-1840024558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-7c7fa8e9-08d6-4ba6-8cdc-6b29b2e43284 req-80437481-a4b6-4820-a918-99c7d9933abd tempest-TaggedAttachmentsTest-1840024558 None] Terminate volume connection completed successfully.
Sep 10 19:09:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-7c7fa8e9-08d6-4ba6-8cdc-6b29b2e43284 req-80437481-a4b6-4820-a918-99c7d9933abd tempest-TaggedAttachmentsTest-1840024558 None] Deleting attachment f69b2d9c-66ff-434c-8b59-cf9fd0203649. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:09:09 devstack quobyte-client[82905]: System call of process 86047 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:09:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" returned: 0 in 0.834s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" returned: 0 in 0.376s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "cinder-quobyte-3a99318a-2db7-4cdc-acd8-2cfd63ead36b" released by "delete_volume" :: held 1.926s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Created reservations ['d9ec5f37-380a-4db0-94fc-aba756d75571', '88bf69cc-c668-47fc-899d-d5f9af612acb', 'a3900cfe-3ff4-4040-b1d1-051889b940a0', 'b6784e0d-e2ae-4c7e-93b6-2a2a771dbfe4'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.427s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:13 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:09:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Deleted volume successfully.
Sep 10 19:09:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-322bce49-f44b-4b18-b01e-0ef212cac1b2 tempest-DeleteServersTestJSON-1338528517 None] Lock "cinder-3a99318a-2db7-4cdc-acd8-2cfd63ead36b-delete_volume" released by "delete_volume" :: held 5.982s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:09:22 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:09:24 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:09:32 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Flow 'volume_create_manager' (f81b4379-1576-4621-b448-8a9a387515d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fce686-4aa9-4f69-84b3-19932ef9b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fce686-4aa9-4f69-84b3-19932ef9b68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-818402193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fe2e7b-258b-4ac0-a360-5756531f0f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869dc0d2313b4068ab0c4179796c9509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:09:32Z,use_quota=True,user_id='18dbb7e666164ecda850e76c8fd22950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e96f9c6-19a7-4b6b-bce6-09a0b84059dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e96f9c6-19a7-4b6b-bce6-09a0b84059dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453ee6b4-ab2a-4eb4-a6e0-557464e6f221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (453ee6b4-ab2a-4eb4-a6e0-557464e6f221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fe2e7b-258b-4ac0-a360-5756531f0f60', 'volume_name': 'volume-16fe2e7b-258b-4ac0-a360-5756531f0f60', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6d572b-e0ba-4ef1-969b-6d4b5c18ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6d572b-e0ba-4ef1-969b-6d4b5c18ae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b843645b-c413-48d0-88dd-4cf3c00717c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Volume 16fe2e7b-258b-4ac0-a360-5756531f0f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fe2e7b-258b-4ac0-a360-5756531f0f60', 'volume_size': 1}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-818402193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fe2e7b-258b-4ac0-a360-5756531f0f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869dc0d2313b4068ab0c4179796c9509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:09:32Z,use_quota=True,user_id='18dbb7e666164ecda850e76c8fd22950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Creating volume 16fe2e7b-258b-4ac0-a360-5756531f0f60 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:09:32 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:09:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:32 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=7, name=volume-16fe2e7b-258b-4ac0-a360-5756531f0f60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 1073741824" returned: 0 in 0.449s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60" returned: 0 in 0.165s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b843645b-c413-48d0-88dd-4cf3c00717c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fe2e7b-258b-4ac0-a360-5756531f0f60', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9786beed-0120-4557-8b3a-3ace6cf6a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Volume volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 (16fe2e7b-258b-4ac0-a360-5756531f0f60): created successfully
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9786beed-0120-4557-8b3a-3ace6cf6a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Flow 'volume_create_manager' (f81b4379-1576-4621-b448-8a9a387515d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:09:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-723b21f8-20bc-4783-851e-e80217a68802 tempest-ServersNegativeTestJSON-1161455263 None] Created volume successfully.
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.892s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:09:37 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:37 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Flow 'volume_create_manager' (65e67798-1758-4ae2-ad26-93cfc21ca7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6445ff4-c40f-4122-a945-89620d7f5a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6445ff4-c40f-4122-a945-89620d7f5a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1441111781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c631d9-780e-4656-964a-f6014ffc5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869dc0d2313b4068ab0c4179796c9509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:09:37Z,use_quota=True,user_id='18dbb7e666164ecda850e76c8fd22950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd0575-3493-4063-ad19-c57d3ab8e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cd0575-3493-4063-ad19-c57d3ab8e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06b7c85-86f9-48c0-aef4-50cf789fb89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06b7c85-86f9-48c0-aef4-50cf789fb89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c631d9-780e-4656-964a-f6014ffc5b9d', 'volume_name': 'volume-28c631d9-780e-4656-964a-f6014ffc5b9d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52433fe8-382d-4a60-869e-288b6dc51128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52433fe8-382d-4a60-869e-288b6dc51128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702f7843-3a0a-4a73-8e34-4f6ba701ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:38 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Volume 28c631d9-780e-4656-964a-f6014ffc5b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c631d9-780e-4656-964a-f6014ffc5b9d', 'volume_size': 1}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1441111781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c631d9-780e-4656-964a-f6014ffc5b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869dc0d2313b4068ab0c4179796c9509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:09:37Z,use_quota=True,user_id='18dbb7e666164ecda850e76c8fd22950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Creating volume 28c631d9-780e-4656-964a-f6014ffc5b9d {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:09:38 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:09:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=8, name=volume-28c631d9-780e-4656-964a-f6014ffc5b9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:09:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d 1073741824" returned: 0 in 0.682s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d" returned: 0 in 0.345s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] <== create_volume: return (1369ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:09:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702f7843-3a0a-4a73-8e34-4f6ba701ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c631d9-780e-4656-964a-f6014ffc5b9d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584ecce3-2748-45b0-ad7e-85cfcea83899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:09:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Volume volume-28c631d9-780e-4656-964a-f6014ffc5b9d (28c631d9-780e-4656-964a-f6014ffc5b9d): created successfully
Sep 10 19:09:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584ecce3-2748-45b0-ad7e-85cfcea83899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:09:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Flow 'volume_create_manager' (65e67798-1758-4ae2-ad26-93cfc21ca7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:09:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-fd6f1a7b-c9e9-44f3-ab1b-abeaaa3c481d tempest-ServersNegativeTestJSON-1161455263 None] Created volume successfully.
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "cinder-28c631d9-780e-4656-964a-f6014ffc5b9d-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-28c631d9-780e-4656-964a-f6014ffc5b9d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:43 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "cinder-quobyte-28c631d9-780e-4656-964a-f6014ffc5b9d" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-quobyte-28c631d9-780e-4656-964a-f6014ffc5b9d" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c1d32-6347-43cd-9bfa-3270b8cbc946]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:09:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:44 devstack quobyte-client[82905]: System call of process 86218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:09:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d" returned: 0 in 1.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-28c631d9-780e-4656-964a-f6014ffc5b9d" returned: 0 in 0.174s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-quobyte-28c631d9-780e-4656-964a-f6014ffc5b9d" released by "delete_volume" :: held 1.760s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Created reservations ['964de350-b158-42af-b90c-e967099f7dab', 'e2c2e73e-ad41-4959-b29a-ee4d58c38245', '594c93e8-5726-4e77-94ef-7b5e3915d072', 'ef1702a4-2c52-4a4b-b3de-fd0bd49100f7'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.104s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:46 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:09:46 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Deleted volume successfully.
Sep 10 19:09:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e94f9662-84f6-4e7d-9454-8280d3520b22 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-28c631d9-780e-4656-964a-f6014ffc5b9d-delete_volume" released by "delete_volume" :: held 4.107s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:09:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "cinder-16fe2e7b-258b-4ac0-a360-5756531f0f60-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-16fe2e7b-258b-4ac0-a360-5756531f0f60-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:09:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "cinder-quobyte-16fe2e7b-258b-4ac0-a360-5756531f0f60" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:09:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-quobyte-16fe2e7b-258b-4ac0-a360-5756531f0f60" acquired by "delete_volume" :: waited 0.040s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:09:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7aabda-ed15-4063-b8a0-95ac061d342c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:09:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:50 devstack quobyte-client[82905]: System call of process 86259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:09:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60" returned: 0 in 1.138s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-16fe2e7b-258b-4ac0-a360-5756531f0f60" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-quobyte-16fe2e7b-258b-4ac0-a360-5756531f0f60" released by "delete_volume" :: held 1.520s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Created reservations ['688f837b-3af7-4d26-aed8-3aedbf80857a', 'e2ed0036-2219-4cc7-8ec6-d508cc18cdf9', 'd700e3da-b5e2-4ca4-91fb-8e85b1c1c004', 'b7203982-21b1-46d1-8842-6064954bb024'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.333s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:09:51 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:09:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Deleted volume successfully.
Sep 10 19:09:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c2adac9c-4b96-485a-85a3-a6863cd480a3 tempest-ServersNegativeTestJSON-1161455263 None] Lock "cinder-16fe2e7b-258b-4ac0-a360-5756531f0f60-delete_volume" released by "delete_volume" :: held 4.045s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "cinder-4af347af-0415-4929-bbc4-6d415dc7663c-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "cinder-4af347af-0415-4929-bbc4-6d415dc7663c-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:10:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "cinder-quobyte-4af347af-0415-4929-bbc4-6d415dc7663c" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "cinder-quobyte-4af347af-0415-4929-bbc4-6d415dc7663c" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf7fa6-89d2-434b-acec-76847376aa9b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c" returned: 0 in 0.599s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4af347af-0415-4929-bbc4-6d415dc7663c" returned: 0 in 0.104s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "cinder-quobyte-4af347af-0415-4929-bbc4-6d415dc7663c" released by "delete_volume" :: held 0.931s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Created reservations ['54276ae2-6ce2-4796-a451-fe423a3ea9ec', '4308d73c-6b15-4ad0-871c-c19fc3d5829d', '9d61592d-a082-4416-b20c-37de281a10b0', 'f113e1f7-4807-448d-83cb-ad44ca169ffa'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:03 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:10:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Deleted volume successfully.
Sep 10 19:10:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b1b67d35-cc1e-4f0c-bbb1-23573bd48caf tempest-TaggedAttachmentsTest-1840024558 None] Lock "cinder-4af347af-0415-4929-bbc4-6d415dc7663c-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:12 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=20,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:10:13 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:10:16 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (d69576c7-dda5-45c7-8422-cf93da3578c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148d32ef-b749-4938-8165-fa078d7f4c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148d32ef-b749-4938-8165-fa078d7f4c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144560285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a7689-f03a-45ed-9087-79da5cf43c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:16Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43112912-5c55-4f85-8e32-a1f2b7708360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43112912-5c55-4f85-8e32-a1f2b7708360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196fcf7c-c1f1-4b7d-b9b8-3be6d83e289c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (196fcf7c-c1f1-4b7d-b9b8-3be6d83e289c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '962a7689-f03a-45ed-9087-79da5cf43c93', 'volume_name': 'volume-962a7689-f03a-45ed-9087-79da5cf43c93', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c5060>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd868e5d-8953-4f0e-94fd-8f559325135c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd868e5d-8953-4f0e-94fd-8f559325135c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e338984-30e6-4e97-8c97-d8c02df4ae1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Volume 962a7689-f03a-45ed-9087-79da5cf43c93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-962a7689-f03a-45ed-9087-79da5cf43c93', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c5060>}
Sep 10 19:10:17 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Cloning 962a7689-f03a-45ed-9087-79da5cf43c93 from image be25800b-1081-46e6-8ee9-2b7d02b2963b  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:10:18 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:10:18 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:10:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47471c29-f7de-44ce-9118-9d590794fcda]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:18 devstack sudo[86376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD
Sep 10 19:10:18 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:20 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1586d05a-a405-4964-9361-778d4c9f17d4 tempest-GroupSnapshotsV319Test-2052268875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1586d05a-a405-4964-9361-778d4c9f17d4 tempest-GroupSnapshotsV319Test-2052268875 None] Group tempest-GroupSnapshotsV319Test-Group-1428266522: creating
Sep 10 19:10:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1586d05a-a405-4964-9361-778d4c9f17d4 tempest-GroupSnapshotsV319Test-2052268875 None] Group tempest-GroupSnapshotsV319Test-Group-1428266522: created successfully
Sep 10 19:10:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1586d05a-a405-4964-9361-778d4c9f17d4 tempest-GroupSnapshotsV319Test-2052268875 None] Create group completed successfully.
Sep 10 19:10:21 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD" returned: 0 in 3.410s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:21 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b is fetched for user e3e876d5f4914593a7d0f5ec8236848d. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4046969d-eea5-4356-9592-61006c642da3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Flow 'volume_create_manager' (089aa228-8769-4d1a-a133-9ea43bf0b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19075c-70d5-41a1-bc94-c36f871d1436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:22 devstack sudo[86381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD
Sep 10 19:10:22 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19075c-70d5-41a1-bc94-c36f871d1436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1332272716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4bfc7435-63be-479f-8e6a-5a6cf84e6e20,host='devstack@QuobyteHD#QuobyteHD',id=0b64edcf-a65d-4744-9af0-29129d0aa2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac05715f05a4a42abd05e3fa6a64bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:22Z,use_quota=True,user_id='1edbfd23ae294763ba020e29258401bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d61d86f-354e-4b45-9582-0772e4dd85d6),volume_type_id=6d61d86f-354e-4b45-9582-0772e4dd85d6)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13922683-84ba-4e7f-a2b5-3d8a31845a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13922683-84ba-4e7f-a2b5-3d8a31845a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dca29e-f046-450f-8a01-438ccb222f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79dca29e-f046-450f-8a01-438ccb222f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b64edcf-a65d-4744-9af0-29129d0aa2f6', 'volume_name': 'volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b9dffa-6cf7-4cbd-bfc4-27b154c7d3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b9dffa-6cf7-4cbd-bfc4-27b154c7d3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1bdf69-0b25-4557-a317-527f163679d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:22 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Volume 0b64edcf-a65d-4744-9af0-29129d0aa2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6', 'volume_size': 1}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4bfc7435-63be-479f-8e6a-5a6cf84e6e20,created_at=2025-09-10T17:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1332272716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4bfc7435-63be-479f-8e6a-5a6cf84e6e20,host='devstack@QuobyteHD#QuobyteHD',id=0b64edcf-a65d-4744-9af0-29129d0aa2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dac05715f05a4a42abd05e3fa6a64bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:22Z,use_quota=True,user_id='1edbfd23ae294763ba020e29258401bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d61d86f-354e-4b45-9582-0772e4dd85d6),volume_type_id=6d61d86f-354e-4b45-9582-0772e4dd85d6)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Creating volume 0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:10:22 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:10:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:23 devstack quobyte-client[82905]: System call of process 86384 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:23 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=9, name=volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 1073741824" returned: 0 in 0.641s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6" returned: 0 in 0.140s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:10:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1bdf69-0b25-4557-a317-527f163679d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a94290-7437-4d34-ad56-44a145271a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:24 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Volume volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 (0b64edcf-a65d-4744-9af0-29129d0aa2f6): created successfully
Sep 10 19:10:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a94290-7437-4d34-ad56-44a145271a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Flow 'volume_create_manager' (089aa228-8769-4d1a-a133-9ea43bf0b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5ca4da32-b6f1-4d9a-9441-b95d6a5dbc9a tempest-GroupSnapshotsV319Test-2052268875 None] Created volume successfully.
Sep 10 19:10:25 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD" returned: 0 in 3.022s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144560285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962a7689-f03a-45ed-9087-79da5cf43c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:16Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Creating volume 962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:10:25 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:25 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=10, name=volume-962a7689-f03a-45ed-9087-79da5cf43c93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:25 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] GroupSnapshot af57d787-ea55-43df-8ea3-d7879620e762: creating.
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 1073741824" returned: 0 in 0.833s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Group snapshot af57d787-ea55-43df-8ea3-d7879620e762: creating. {{(pid=82863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 0.352s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] <== create_volume: return (1219ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Creating offline snapshot dbb5a150-cb97-4987-ab0a-647f467dff93 of volume 0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef7a9cb-275a-4c04-ba1d-8bfe83f32a7c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Attempting download of be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 962a7689-f03a-45ed-9087-79da5cf43c93. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7e6eec-3e2b-4f96-9da1-2c139fb06cba]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_sz6phvv0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6" returned: 0 in 0.663s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:27 devstack quobyte-client[82905]: System call of process 86400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:27 devstack quobyte-client[82905]: System call of process 86400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:27 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=11, name=volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_sz6phvv0" returned: 0 in 0.509s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_sz6phvv0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 1G" returned: 0 in 0.461s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:27 devstack quobyte-client[82905]: System call of process 86405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "qemu-img rebase -u -b volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.273s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_sz6phvv0" returned: 1 in 0.610s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_sz6phvv0' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d86f2-e95b-437d-952b-77f27087e188]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.208s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.130s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.info" returned: 0 in 0.184s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.info" returned: 0 in 0.169s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.543s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:29 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] be25800b-1081-46e6-8ee9-2b7d02b2963b was qcow2, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:10:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:29 devstack quobyte-client[82905]: System call of process 86417 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:29 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=10, name=volume-962a7689-f03a-45ed-9087-79da5cf43c93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e7938105-5a90-4726-b851-c8e43c04c484 tempest-GroupSnapshotsV319Test-2052268875 None] group_snapshot af57d787-ea55-43df-8ea3-d7879620e762: created successfully
Sep 10 19:10:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 1.604s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:30 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_k9rsz112devstack@QuobyteHD, size 112.00 MB, duration 1.61 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:10:30 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Converted 112.00 MB image at 69.50 MB/s
Sep 10 19:10:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 1G" returned: 0 in 0.181s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] group_snapshot af57d787-ea55-43df-8ea3-d7879620e762: deleting
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15079f3-4e74-443d-aade-7c78301c50be]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] group_snapshot af57d787-ea55-43df-8ea3-d7879620e762: deleting {{(pid=82863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" acquired by "delete_snapshot" :: waited 0.063s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "cinder-quobyte-dbb5a150-cb97-4987-ab0a-647f467dff93" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-dbb5a150-cb97-4987-ab0a-647f467dff93" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Deleting offline snapshot dbb5a150-cb97-4987-ab0a-647f467dff93 of volume 0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] snapshot_file for this snap is: volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6376c-11b7-43f3-bb62-a4691d6bf504]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:31 devstack quobyte-client[82905]: System call of process 86432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 0.705s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.544s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3692bd-b24f-43ac-91e4-2ef2cf572f9e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 1 in 0.594s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Downloaded image be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 962a7689-f03a-45ed-9087-79da5cf43c93 successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b for user e3e876d5f4914593a7d0f5ec8236848d is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Marking volume 962a7689-f03a-45ed-9087-79da5cf43c93 as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Copying metadata from image be25800b-1081-46e6-8ee9-2b7d02b2963b to 962a7689-f03a-45ed-9087-79da5cf43c93. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:10:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Creating volume glance metadata for volume 962a7689-f03a-45ed-9087-79da5cf43c93 backed by image be25800b-1081-46e6-8ee9-2b7d02b2963b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:10:33 devstack quobyte-client[82905]: System call of process 86439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e338984-30e6-4e97-8c97-d8c02df4ae1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962a7689-f03a-45ed-9087-79da5cf43c93', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c5060>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df562829-cf93-48c5-a3a3-70449160cfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Volume volume-962a7689-f03a-45ed-9087-79da5cf43c93 (962a7689-f03a-45ed-9087-79da5cf43c93): created successfully
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df562829-cf93-48c5-a3a3-70449160cfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (d69576c7-dda5-45c7-8422-cf93da3578c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6" returned: 0 in 0.683s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:33 devstack quobyte-client[82905]: System call of process 86443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8d1f060b-9f83-481b-987e-302e7626b91b tempest-TaggedBootDevicesTest-516323745 None] Created volume successfully.
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.409s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6.dbb5a150-cb97-4987-ab0a-647f467dff93" returned: 0 in 0.200s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-dbb5a150-cb97-4987-ab0a-647f467dff93" released by "_delete_snapshot" :: held 2.312s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" released by "delete_snapshot" :: held 2.378s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (2a72b9ab-6e37-4b19-ad59-1d05d97c33f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55daa00f-4bc4-45d4-9324-abf397f45c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55daa00f-4bc4-45d4-9324-abf397f45c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1558051136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1567207-7356-43ea-81ad-3c49c6feae27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:34Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05420a0e-e1d5-4045-9a56-77c30465e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05420a0e-e1d5-4045-9a56-77c30465e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea43e2ba-5b79-476b-ba2a-3f31d754de44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea43e2ba-5b79-476b-ba2a-3f31d754de44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1567207-7356-43ea-81ad-3c49c6feae27', 'volume_name': 'volume-e1567207-7356-43ea-81ad-3c49c6feae27', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b11a56-4cc6-495c-9711-5559308d08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11b11a56-4cc6-495c-9711-5559308d08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59719c0-0dfd-4dbd-8eae-d78917713056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:34 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Volume e1567207-7356-43ea-81ad-3c49c6feae27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1567207-7356-43ea-81ad-3c49c6feae27', 'volume_size': 1}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1558051136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1567207-7356-43ea-81ad-3c49c6feae27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:34Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Creating volume e1567207-7356-43ea-81ad-3c49c6feae27 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:10:34 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:10:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:34 devstack quobyte-client[82905]: System call of process 86447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:10:34 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=13, name=volume-e1567207-7356-43ea-81ad-3c49c6feae27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:35 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1369373511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1369373511, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:10:35 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1369373511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1369373511, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 1073741824" returned: 0 in 0.694s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] Created reservations ['d56164f1-b35f-4d87-bbfa-ede46fdb973b', '8c8f972a-0bce-4176-b5b1-83617fe1f000', '5731ae1a-11b5-4d32-ab43-6f6cafd2017f', '5adcdd04-2ae0-4f93-9dfa-c24a3b00af4d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27" returned: 0 in 0.388s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] <== create_volume: return (1112ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59719c0-0dfd-4dbd-8eae-d78917713056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1567207-7356-43ea-81ad-3c49c6feae27', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa29ca8b-9067-4b39-b950-908d1aab3ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:35 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Volume volume-e1567207-7356-43ea-81ad-3c49c6feae27 (e1567207-7356-43ea-81ad-3c49c6feae27): created successfully
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa29ca8b-9067-4b39-b950-908d1aab3ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (2a72b9ab-6e37-4b19-ad59-1d05d97c33f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-be36c5e2-a202-45de-b747-55ddcd7a6c49 tempest-TaggedBootDevicesTest-516323745 None] Created volume successfully.
Sep 10 19:10:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cd846f6f-cbfd-4c0a-9350-067adaa80c84 tempest-GroupSnapshotsV319Test-2052268875 None] group_snapshot af57d787-ea55-43df-8ea3-d7879620e762: deleted successfully
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.338s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:10:37 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (8d4f78c7-caf7-4905-85e1-b889887c1fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66eee3-fcdd-4847-8bc8-34edd0faaf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66eee3-fcdd-4847-8bc8-34edd0faaf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1692462462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de59efd5-7ed8-46c7-86b8-14cb0f8526fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:37Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9b1f6c-6c64-495d-918c-54be9700cc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b9b1f6c-6c64-495d-918c-54be9700cc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683dfed-e0e0-4895-9c88-24f23598f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9683dfed-e0e0-4895-9c88-24f23598f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de59efd5-7ed8-46c7-86b8-14cb0f8526fd', 'volume_name': 'volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019addb7-d65a-4906-afef-69d6eb50e197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019addb7-d65a-4906-afef-69d6eb50e197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef96db-b8cf-4341-b239-0fd0d0147082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Volume de59efd5-7ed8-46c7-86b8-14cb0f8526fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd', 'volume_size': 1}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1692462462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de59efd5-7ed8-46c7-86b8-14cb0f8526fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372e770efcf74a789c99cd5ee219fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:10:37Z,use_quota=True,user_id='e3e876d5f4914593a7d0f5ec8236848d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Creating volume de59efd5-7ed8-46c7-86b8-14cb0f8526fd {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:10:37 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:10:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:37 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:10:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=14, name=volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" acquired by "delete_volume" :: waited 0.160s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd 1073741824" returned: 0 in 0.746s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a1baa-2d58-4c5a-98cb-9f6353792566]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:10:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" returned: 0 in 0.459s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] <== create_volume: return (1284ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8ef96db-b8cf-4341-b239-0fd0d0147082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414cf02-0968-40e4-a9e6-e5babc88e50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:10:39 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Volume volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd (de59efd5-7ed8-46c7-86b8-14cb0f8526fd): created successfully
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414cf02-0968-40e4-a9e6-e5babc88e50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Flow 'volume_create_manager' (8d4f78c7-caf7-4905-85e1-b889887c1fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:10:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2b7d3b4e-b870-4da5-a462-d0769cb1be39 tempest-TaggedBootDevicesTest-516323745 None] Created volume successfully.
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6" returned: 0 in 1.152s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0b64edcf-a65d-4744-9af0-29129d0aa2f6" returned: 0 in 0.226s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "cinder-quobyte-0b64edcf-a65d-4744-9af0-29129d0aa2f6" released by "delete_volume" :: held 1.924s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:10:40 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Created reservations ['ac72bff2-05e2-49ab-85f6-17560cb7f91c'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:10:41 devstack cinder-volume[82863]: WARNING cinder.quota [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1369373511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1369373511, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Created reservations ['9655c5b3-67cb-4542-8f0d-ffb5161752d6', 'ba628f36-4b9d-4858-ba2b-4b617f8290fd', '30a66e48-df0a-41b6-a936-c294f3ad866b', '14bb3c92-924e-42f6-a5a0-e78d49054917'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.121s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:10:41 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:10:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0c23fc5a-b539-44c5-a541-27ab3b7da804 tempest-GroupSnapshotsV319Test-2052268875 None] Delete group completed successfully.
Sep 10 19:10:51 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=27,cinder:UPDATE=29,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:10:51 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=29,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:11:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:14 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a4214-11b0-44c7-8729-46a9269b5939]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:11:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:15 devstack quobyte-client[82905]: System call of process 86599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:11:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 1.155s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 1 in 1.975s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:11:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.632s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-962a7689-f03a-45ed-9087-79da5cf43c93', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7647b041-d8b7-497a-aaa3-38ce3dbbbac1', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:11:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:11:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Flow 'volume_create_manager' (e21180b8-1db2-4491-aa87-fc820216af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e0418a-5a59-4153-8fc8-5d7c05f77c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:19 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-ed90c5c3-820e-4319-86c7-48cd57184744 tempest-TaggedBootDevicesTest-516323745 None] attachment_update completed successfully.
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45e0418a-5a59-4153-8fc8-5d7c05f77c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1351664522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e784af-9062-4887-bbec-49c3f8793bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075e571cc6664e53ba5838a0f5655fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:11:18Z,use_quota=True,user_id='f02909211360403a9ba2e068a91643e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1e2a09-e789-4e46-81c8-0ad88eafd312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d1e2a09-e789-4e46-81c8-0ad88eafd312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafad5fe-577a-4bb2-b164-7a3a0ebe62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafad5fe-577a-4bb2-b164-7a3a0ebe62a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e784af-9062-4887-bbec-49c3f8793bfe', 'volume_name': 'volume-32e784af-9062-4887-bbec-49c3f8793bfe', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c3cab-6072-43df-81a0-d448e753e09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c3cab-6072-43df-81a0-d448e753e09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63253f40-ccbd-429c-8d20-d2f1ab65388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:19 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Volume 32e784af-9062-4887-bbec-49c3f8793bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e784af-9062-4887-bbec-49c3f8793bfe', 'volume_size': 1}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1351664522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e784af-9062-4887-bbec-49c3f8793bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='075e571cc6664e53ba5838a0f5655fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:11:18Z,use_quota=True,user_id='f02909211360403a9ba2e068a91643e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Creating volume 32e784af-9062-4887-bbec-49c3f8793bfe {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:11:19 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:11:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=15, name=volume-32e784af-9062-4887-bbec-49c3f8793bfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:11:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe 1073741824" returned: 0 in 0.811s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe" returned: 0 in 0.267s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] <== create_volume: return (1251ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:11:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63253f40-ccbd-429c-8d20-d2f1ab65388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e784af-9062-4887-bbec-49c3f8793bfe', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc2339-6223-421d-a596-0a7e7b8f1ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:11:22 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Volume volume-32e784af-9062-4887-bbec-49c3f8793bfe (32e784af-9062-4887-bbec-49c3f8793bfe): created successfully
Sep 10 19:11:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc2339-6223-421d-a596-0a7e7b8f1ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:11:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Flow 'volume_create_manager' (e21180b8-1db2-4491-aa87-fc820216af01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:11:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-14b2943e-3ccd-43eb-9a8d-e0677d9d87f2 tempest-VolumesServicesTestJSON-1603675813 None] Created volume successfully.
Sep 10 19:11:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Acquiring lock "cinder-32e784af-9062-4887-bbec-49c3f8793bfe-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:11:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "cinder-32e784af-9062-4887-bbec-49c3f8793bfe-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:11:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:11:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Acquiring lock "cinder-quobyte-32e784af-9062-4887-bbec-49c3f8793bfe" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:11:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "cinder-quobyte-32e784af-9062-4887-bbec-49c3f8793bfe" acquired by "delete_volume" :: waited 0.030s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:11:24 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ecca64-2a3a-458f-84e5-d8db62545a35]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:11:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:25 devstack quobyte-client[82905]: System call of process 86632 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:11:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe" returned: 0 in 1.565s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.024s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-32e784af-9062-4887-bbec-49c3f8793bfe" returned: 0 in 0.302s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6a84b-57ed-4f26-8276-32a02fd3ab0f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "cinder-quobyte-32e784af-9062-4887-bbec-49c3f8793bfe" released by "delete_volume" :: held 2.497s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:11:27 devstack quobyte-client[82905]: System call of process 86637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:11:27 devstack quobyte-client[82905]: System call of process 86637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27" returned: 0 in 1.215s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.315s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Created reservations ['64f4e82b-2d61-4670-95f6-475b163f6df7', '1774b5d7-0163-46a0-a377-01b4802f82d8', '4cd92ec1-5a09-4b16-97b1-75526ae13e0e', '5686cca6-3c27-490b-996e-d43e33f2b57e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-e1567207-7356-43ea-81ad-3c49c6feae27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e813e79-f74a-44a1-9aa6-ca8417b11d8e', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:11:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.949s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:28 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:11:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Deleted volume successfully.
Sep 10 19:11:29 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a82d330f-2a0f-4ecf-b6a8-22f423809518 tempest-VolumesServicesTestJSON-1603675813 None] Lock "cinder-32e784af-9062-4887-bbec-49c3f8793bfe-delete_volume" released by "delete_volume" :: held 5.304s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:11:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-8208d88f-f447-460f-ae94-286457f11338 tempest-TaggedBootDevicesTest-516323745 None] attachment_update completed successfully.
Sep 10 19:11:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.033s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[01268ddd-5a02-4859-ac3a-43693ffbe3e6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:11:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:34 devstack quobyte-client[82905]: System call of process 86653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:11:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" returned: 0 in 0.973s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.228s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d5677e8-2235-4b13-81ec-f3eff7ab066f', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:11:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:11:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-ccb048f2-b1ca-4377-a393-5960f7cce1cc req-bd38ad04-1c70-4a4f-b037-4e9087c8bcfc tempest-TaggedBootDevicesTest-516323745 None] attachment_update completed successfully.
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:11:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:11:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.387s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:11:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:11:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:DELETE=1,cinder:INSERT=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:11:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=21,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:12:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:12:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:12:26 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:12:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (4736c692-5006-47d9-881b-7e67ab638cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:12:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e3dad3-a785-44f9-8711-dccb63f18aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e3dad3-a785-44f9-8711-dccb63f18aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1098013356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4ea392-0827-4f3b-ac8c-6d8c651b3efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:12:27Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3faba4-5ede-42ac-9c49-3bacad814beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3faba4-5ede-42ac-9c49-3bacad814beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0a8bb6-7640-4d39-a2e0-764de70fba5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a0a8bb6-7640-4d39-a2e0-764de70fba5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4ea392-0827-4f3b-ac8c-6d8c651b3efa', 'volume_name': 'volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f199a3-aec1-41bc-9a99-f6138edb87c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f199a3-aec1-41bc-9a99-f6138edb87c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5cc9aa-1231-4f1b-bc16-fb7bef636052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:27 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Volume ef4ea392-0827-4f3b-ac8c-6d8c651b3efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa', 'volume_size': 1}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1098013356',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4ea392-0827-4f3b-ac8c-6d8c651b3efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:12:27Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Creating volume ef4ea392-0827-4f3b-ac8c-6d8c651b3efa {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:12:27 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:27 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=16, name=volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa 1073741824" returned: 0 in 0.618s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" returned: 0 in 0.214s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] <== create_volume: return (1022ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5cc9aa-1231-4f1b-bc16-fb7bef636052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7c196f-8ba6-4884-a5a9-0c7e5b45a187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:12:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Volume volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa (ef4ea392-0827-4f3b-ac8c-6d8c651b3efa): created successfully
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7c196f-8ba6-4884-a5a9-0c7e5b45a187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:12:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (4736c692-5006-47d9-881b-7e67ab638cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:12:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f8e681b9-770e-47aa-802b-47228360f03b tempest-AttachVolumeNegativeTest-2110365285 None] Created volume successfully.
Sep 10 19:12:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:12:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:12:34 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e071591-e951-498c-a0e1-8fb3191d8015]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:12:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:35 devstack quobyte-client[82905]: System call of process 87590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:12:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" returned: 0 in 1.015s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.130s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf595645-89ae-4c73-8818-04a0c7a5d6de', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:12:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:12:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:12:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-c89e834c-3e2e-4111-82af-943b9419009e req-3f2dea9e-80d1-4950-83ba-202d4f698ff9 tempest-AttachVolumeNegativeTest-2110365285 None] attachment_update completed successfully.
Sep 10 19:12:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.791s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:12:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:12:46 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:12:46 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:13:32 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (d5c06e16-3058-46e4-8698-34724cf1c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af36242-969e-4dc9-8929-72e8abf95c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af36242-969e-4dc9-8929-72e8abf95c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046529259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d9cd82-597f-4c3c-acb1-ee240562a68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:13:32Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aeab20-5133-4823-b7a2-7e159d18f546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27aeab20-5133-4823-b7a2-7e159d18f546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed91c20-9147-4300-8ecb-2ef7f2fd4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ed91c20-9147-4300-8ecb-2ef7f2fd4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d9cd82-597f-4c3c-acb1-ee240562a68d', 'volume_name': 'volume-77d9cd82-597f-4c3c-acb1-ee240562a68d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6547e9c-937c-472e-b29d-e4eeb368c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6547e9c-937c-472e-b29d-e4eeb368c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306db74-9c58-407e-8bc1-330ca40c5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Volume 77d9cd82-597f-4c3c-acb1-ee240562a68d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d9cd82-597f-4c3c-acb1-ee240562a68d', 'volume_size': 1}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046529259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d9cd82-597f-4c3c-acb1-ee240562a68d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:13:32Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Creating volume 77d9cd82-597f-4c3c-acb1-ee240562a68d {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:13:32 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:13:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:33 devstack quobyte-client[82905]: System call of process 87890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:13:33 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=17, name=volume-77d9cd82-597f-4c3c-acb1-ee240562a68d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:13:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d 1073741824" returned: 0 in 0.850s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d" returned: 0 in 0.109s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (1071ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:13:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:13:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f306db74-9c58-407e-8bc1-330ca40c5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d9cd82-597f-4c3c-acb1-ee240562a68d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5616f271-6278-4082-ba6d-9ca4ccf07616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:34 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Volume volume-77d9cd82-597f-4c3c-acb1-ee240562a68d (77d9cd82-597f-4c3c-acb1-ee240562a68d): created successfully
Sep 10 19:13:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5616f271-6278-4082-ba6d-9ca4ccf07616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (d5c06e16-3058-46e4-8698-34724cf1c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:13:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-86fa54ce-39c5-463c-a1ea-96ebf2474d94 tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:13:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d" by "attach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:13:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d" acquired by "attach_volume" :: waited 0.084s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:13:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:36 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Attaching volume 77d9cd82-597f-4c3c-acb1-ee240562a68d to instance fb5f214e-530e-4b20-9d1d-ecf07b9646af at mountpoint /dev/vdb on host None.
Sep 10 19:13:36 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Attach volume completed successfully.
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc426c2f-40ec-46d1-a4c7-503e1a0cd155 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d" released by "attach_volume" :: held 0.599s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:13:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.289s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:13:37 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Terminate volume connection completed successfully.
Sep 10 19:13:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" by "detach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:13:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" acquired by "detach_volume" :: waited 0.086s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:13:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Detaching volume 77d9cd82-597f-4c3c-acb1-ee240562a68d from instance fb5f214e-530e-4b20-9d1d-ecf07b9646af.
Sep 10 19:13:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Detach volume completed successfully.
Sep 10 19:13:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b0929a19-a85a-49ec-bfc9-9a2281fd6f21 tempest-VolumesActionsTest-586952623 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" released by "detach_volume" :: held 0.257s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:13:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2581554c-4a7e-4358-a8c7-6e49e895287d tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" by "detach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:13:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2581554c-4a7e-4358-a8c7-6e49e895287d tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:13:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2581554c-4a7e-4358-a8c7-6e49e895287d tempest-VolumesActionsTest-1793398315 None] Volume detach called, but volume not attached.
Sep 10 19:13:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2581554c-4a7e-4358-a8c7-6e49e895287d tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:13:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:13:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:13:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-quobyte-77d9cd82-597f-4c3c-acb1-ee240562a68d" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:13:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-quobyte-77d9cd82-597f-4c3c-acb1-ee240562a68d" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:13:40 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d6002-142b-45d2-9184-bb458cf95d87]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:13:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:41 devstack quobyte-client[82905]: System call of process 87906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:13:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d" returned: 0 in 0.889s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-77d9cd82-597f-4c3c-acb1-ee240562a68d" returned: 0 in 0.249s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-quobyte-77d9cd82-597f-4c3c-acb1-ee240562a68d" released by "delete_volume" :: held 1.405s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Created reservations ['f0afbed8-116a-4d91-8ab5-3bdb9d000015', 'b8c0d299-3f9d-4252-bbe0-c6bc58de98b2', '712990e1-2457-4cb3-b288-3c41c7ecadb6', '4cb95434-eaad-4080-948f-3b17787e5740'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.419s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:43 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:13:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Deleted volume successfully.
Sep 10 19:13:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-02e5c813-b4f6-46b6-8991-3de42edb0064 tempest-VolumesActionsTest-1793398315 None] Lock "cinder-77d9cd82-597f-4c3c-acb1-ee240562a68d-delete_volume" released by "delete_volume" :: held 4.023s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:13:52 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:13:53 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=14,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:13:59 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (8ed6f969-f28d-4dd4-a76b-0d3e28162d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c0027a-60d8-458a-b26d-7e18e8be7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c0027a-60d8-458a-b26d-7e18e8be7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23971346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:13:59Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac63f8b-831e-4de2-b2af-1d70ef73d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac63f8b-831e-4de2-b2af-1d70ef73d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd047b10-7e5e-410f-98e9-edbbc10210ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd047b10-7e5e-410f-98e9-edbbc10210ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5', 'volume_name': 'volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a9d1fe-4a11-4a86-a2be-2963e45d0675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a9d1fe-4a11-4a86-a2be-2963e45d0675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3908186-c569-4ba9-9624-e4aa5e291599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:13:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Volume 725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5', 'volume_size': 1}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-23971346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:13:59Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Creating volume 725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:13:59 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:13:59 devstack quobyte-client[82905]: System call of process 88007 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:13:59 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=18, name=volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 1073741824" returned: 0 in 0.475s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:13:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" returned: 0 in 0.181s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3908186-c569-4ba9-9624-e4aa5e291599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f057da4-30e7-4b24-8687-020e6ac45d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:00 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Volume volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 (725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5): created successfully
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f057da4-30e7-4b24-8687-020e6ac45d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (8ed6f969-f28d-4dd4-a76b-0d3e28162d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0dd7a6e7-9faf-41c2-b5f8-0c8fa575c104 tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "cinder-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-quobyte-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13dc32a-2057-4baa-8d50-e6a6bf6f8923]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:14:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" returned: 0 in 0.527s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" returned: 0 in 0.147s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5" released by "delete_volume" :: held 0.836s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:02 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Created reservations ['5e341bad-c3f6-4737-a1e9-4dacca77701d', 'e37cd7a4-e922-4bab-bed9-fd8c5619ebd7', '69cd7a44-64a5-4d1d-aa2f-578d05c19f26', '6b2cdca0-89cf-42da-8707-1de8f472b748'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.107s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Deleted volume successfully.
Sep 10 19:14:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50554d81-9220-439c-9fde-fd86c6c38375 tempest-VolumesActionsTest-586952623 None] Lock "cinder-725e3e16-7c1a-4e4d-9dbe-bcc76e9cabf5-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (ba5f3483-72c9-4415-8e82-c79c39ba61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9ff25-b284-4394-b738-a3e3ad18de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fa9ff25-b284-4394-b738-a3e3ad18de6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1552773946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de7ef85-d5df-4e98-97b7-1f1e56a1e93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:04Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc308c52-ae7c-43a0-b7ed-8d9b31064f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc308c52-ae7c-43a0-b7ed-8d9b31064f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7249098-b26e-4d95-9f6e-bef03d5402f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7249098-b26e-4d95-9f6e-bef03d5402f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de7ef85-d5df-4e98-97b7-1f1e56a1e93f', 'volume_name': 'volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca044c-cca7-4839-88c9-929bf0560190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ca044c-cca7-4839-88c9-929bf0560190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b280603c-bf6c-4723-8773-b1a5b2c9b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:04 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Volume 8de7ef85-d5df-4e98-97b7-1f1e56a1e93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f', 'volume_size': 1}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1552773946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de7ef85-d5df-4e98-97b7-1f1e56a1e93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:04Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Creating volume 8de7ef85-d5df-4e98-97b7-1f1e56a1e93f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:14:04 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:14:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:04 devstack quobyte-client[82905]: System call of process 88019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:14:04 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=19, name=volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f 1073741824" returned: 0 in 0.452s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" returned: 0 in 0.169s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (703ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b280603c-bf6c-4723-8773-b1a5b2c9b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53419dad-d2a7-4c2f-be0f-7d103211fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:05 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Volume volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f (8de7ef85-d5df-4e98-97b7-1f1e56a1e93f): created successfully
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53419dad-d2a7-4c2f-be0f-7d103211fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (ba5f3483-72c9-4415-8e82-c79c39ba61f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-29f7ecc5-7b8e-4f52-8369-3e966127cce3 tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:14:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "cinder-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:07 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-quobyte-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" acquired by "delete_volume" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4eb97ea-144f-49b8-b277-89971ce7755a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:07 devstack quobyte-client[82905]: System call of process 88034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" returned: 0 in 0.520s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" returned: 0 in 0.121s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f" released by "delete_volume" :: held 0.815s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Created reservations ['1ffda617-f555-4822-95e8-a1f820c629ad', 'bbb49c77-f7d0-4119-968f-29f157c50a1b', '6554501f-b118-4a9f-bf5d-b31958a98e4d', '36d513eb-0830-45bf-a5d1-8b876d6bce6c'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.112s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Deleted volume successfully.
Sep 10 19:14:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fdb27107-3e76-4df9-b96a-1416d201de13 tempest-VolumesActionsTest-586952623 None] Lock "cinder-8de7ef85-d5df-4e98-97b7-1f1e56a1e93f-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:09 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (ad2fcc31-3e49-4475-85dd-2fbe938ccf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f09f4-d48f-429b-bd5f-0aacc3ff908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f09f4-d48f-429b-bd5f-0aacc3ff908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1057862238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d2566-3aaf-47d1-aed3-02955bbe1e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:10Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2394f4-55f5-49bc-a6d3-034d2582d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c2394f4-55f5-49bc-a6d3-034d2582d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5eb709b-abe0-4cd7-abdb-88c4686ba52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5eb709b-abe0-4cd7-abdb-88c4686ba52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '474d2566-3aaf-47d1-aed3-02955bbe1e8c', 'volume_name': 'volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93957229-32b6-477c-b6ee-f9bc875e0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93957229-32b6-477c-b6ee-f9bc875e0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d43b8-4db9-4112-8f70-490912cf6575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:10 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Volume 474d2566-3aaf-47d1-aed3-02955bbe1e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c', 'volume_size': 1}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1057862238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=474d2566-3aaf-47d1-aed3-02955bbe1e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:10Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Creating volume 474d2566-3aaf-47d1-aed3-02955bbe1e8c {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:14:10 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:10 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=20, name=volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c 1073741824" returned: 0 in 0.458s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c" returned: 0 in 0.205s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:14:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096d43b8-4db9-4112-8f70-490912cf6575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d5a5c8-4cce-466c-a682-750a5d07d71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:11 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Volume volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c (474d2566-3aaf-47d1-aed3-02955bbe1e8c): created successfully
Sep 10 19:14:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d5a5c8-4cce-466c-a682-750a5d07d71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (ad2fcc31-3e49-4475-85dd-2fbe938ccf18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:11 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ad17e423-0aa6-4458-91ab-47d254297af8 tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-474d2566-3aaf-47d1-aed3-02955bbe1e8c-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "cinder-474d2566-3aaf-47d1-aed3-02955bbe1e8c-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-quobyte-474d2566-3aaf-47d1-aed3-02955bbe1e8c" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-474d2566-3aaf-47d1-aed3-02955bbe1e8c" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66c0bda-dc32-4bb9-a953-423545308a9d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:14:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c" returned: 0 in 0.782s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-474d2566-3aaf-47d1-aed3-02955bbe1e8c" returned: 0 in 0.135s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-474d2566-3aaf-47d1-aed3-02955bbe1e8c" released by "delete_volume" :: held 1.209s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Created reservations ['85fb4f3a-6e9d-4b33-9065-b1a7c6c23642', '48cf5ab2-2054-4023-9928-1227d64a2434', '05f033a1-3021-4f00-8dad-6def0b32362b', 'd43e9404-0c5b-4885-99d7-e9e8c5d5adbb'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.139s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Deleted volume successfully.
Sep 10 19:14:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-50dca249-eff9-44d3-8ce5-2a7b4dda35af tempest-VolumesActionsTest-586952623 None] Lock "cinder-474d2566-3aaf-47d1-aed3-02955bbe1e8c-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (6aa8ce33-80dd-441c-b58f-1770f43b9f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d640a1e-8986-4830-9149-0fddcfad9c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d640a1e-8986-4830-9149-0fddcfad9c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928065120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5dd0aa-2e05-451e-94a1-e088ef06c3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:15Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ad7ad-8d48-4dc0-904a-10c03cd80e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487ad7ad-8d48-4dc0-904a-10c03cd80e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635ad29a-fc27-4b7b-87c3-0d4a703867f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635ad29a-fc27-4b7b-87c3-0d4a703867f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5dd0aa-2e05-451e-94a1-e088ef06c3f6', 'volume_name': 'volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf92f56d-579b-4d56-91dd-c306c395e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf92f56d-579b-4d56-91dd-c306c395e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e80fd2-2ee0-4689-aa1e-13c1c0fb922b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:15 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Volume 1e5dd0aa-2e05-451e-94a1-e088ef06c3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6', 'volume_size': 1}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1928065120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5dd0aa-2e05-451e-94a1-e088ef06c3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:15Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Creating volume 1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:14:15 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:14:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:15 devstack quobyte-client[82905]: System call of process 88055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:14:15 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=21, name=volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 1073741824" returned: 0 in 0.402s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e80fd2-2ee0-4689-aa1e-13c1c0fb922b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051e7c18-d117-4914-a940-e221b6e89508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:16 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Volume volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 (1e5dd0aa-2e05-451e-94a1-e088ef06c3f6): created successfully
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (051e7c18-d117-4914-a940-e221b6e89508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (6aa8ce33-80dd-441c-b58f-1770f43b9f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:16 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-080d1e50-15bb-448a-84bb-341ee99bf56f tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "cinder-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Acquiring lock "cinder-quobyte-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd57ce4-0f9c-4e39-b507-0baa12c5015d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" returned: 0 in 0.552s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" returned: 0 in 0.101s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "cinder-quobyte-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6" released by "delete_volume" :: held 0.827s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Created reservations ['4d754a49-9e00-484f-b7d3-8089adab3838', '096bb664-e501-4131-85be-be98b8571d92', '4c5992d4-6f6d-499b-86d6-ab895b95c363', 'c22c84dd-7356-48fd-a619-85c5ac12d107'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.094s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:20 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Deleted volume successfully.
Sep 10 19:14:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0bdea5ee-bdf8-4c9c-bbc1-c925344dae4b tempest-VolumesActionsTest-586952623 None] Lock "cinder-1e5dd0aa-2e05-451e-94a1-e088ef06c3f6-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:20 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:20 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (aff7c0e5-c8bc-4bd3-b265-fcb9c2117b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6251f-d907-4afd-945f-dccd5d49d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab6251f-d907-4afd-945f-dccd5d49d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602635302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1ccfb7-a1a1-4355-b38f-f0f22be65f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:21Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43879c0-3467-4396-9b32-4bcd079058f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43879c0-3467-4396-9b32-4bcd079058f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bfddbc-d0ef-4c2a-9c3d-46508fa9e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19bfddbc-d0ef-4c2a-9c3d-46508fa9e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1ccfb7-a1a1-4355-b38f-f0f22be65f13', 'volume_name': 'volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b47d12-d97c-476f-aaf3-d72a177d9264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b47d12-d97c-476f-aaf3-d72a177d9264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd7f7ab-79be-4163-91f3-a9a13f06571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Volume 4c1ccfb7-a1a1-4355-b38f-f0f22be65f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13', 'volume_size': 1}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1602635302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1ccfb7-a1a1-4355-b38f-f0f22be65f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d8eaf82dced4b3faaac73f91076c72d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:14:21Z,use_quota=True,user_id='4e9100a6f4b243fd80e5baf8b79118f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Creating volume 4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:14:21 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:21 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=22, name=volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 1073741824" returned: 0 in 0.363s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" returned: 0 in 0.122s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.573s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fd7f7ab-79be-4163-91f3-a9a13f06571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8142e1-88c7-4b9c-857d-1d0808fca999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:14:21 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Volume volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 (4c1ccfb7-a1a1-4355-b38f-f0f22be65f13): created successfully
Sep 10 19:14:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb8142e1-88c7-4b9c-857d-1d0808fca999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:14:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Flow 'volume_create_manager' (aff7c0e5-c8bc-4bd3-b265-fcb9c2117b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:14:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ef0eceef-9f80-45ee-a84b-154740ae7501 tempest-VolumesActionsTest-1793398315 None] Created volume successfully.
Sep 10 19:14:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "cinder-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13-delete_volume" acquired by "delete_volume" :: waited 0.294s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Acquiring lock "cinder-quobyte-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:14:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "cinder-quobyte-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" acquired by "delete_volume" :: waited 0.071s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:14:27 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5471ea-d508-4e20-966d-683d1fa160bb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:14:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:29 devstack quobyte-client[82905]: System call of process 88211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:14:29 devstack quobyte-client[82905]: System call of process 88211 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:14:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" returned: 0 in 2.468s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" returned: 0 in 0.481s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "cinder-quobyte-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13" released by "delete_volume" :: held 4.534s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Created reservations ['caf61e52-028c-48a0-a8e0-c089b727561f', '2daa0a05-4924-40ab-9111-dbbfdac06c06', 'ea4aec8a-ef17-41b7-a84c-c238c8c25873', 'bbe17aee-8edd-4ece-ac4f-3f0acc2910ab'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.575s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:33 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Deleted volume successfully.
Sep 10 19:14:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16144c09-3e78-4652-9c08-4ea33cade35e tempest-VolumesActionsTest-1793398315 None] Lock "cinder-4c1ccfb7-a1a1-4355-b38f-f0f22be65f13-delete_volume" released by "delete_volume" :: held 8.617s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:14:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:14:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.341s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:14:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:14:42 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=53,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:14:43 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=38,cinder:UPDATE=48,cinder:DELETE=8,cinder:INSERT=14 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:14:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-c5b03c77-5bfa-4b2e-8a9f-661e00564031 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-c5b03c77-5bfa-4b2e-8a9f-661e00564031 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-c5b03c77-5bfa-4b2e-8a9f-661e00564031 tempest-TaggedBootDevicesTest-516323745 None] Terminate volume connection completed successfully.
Sep 10 19:14:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-c5b03c77-5bfa-4b2e-8a9f-661e00564031 tempest-TaggedBootDevicesTest-516323745 None] Deleting attachment 7647b041-d8b7-497a-aaa3-38ce3dbbbac1. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:14:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-1233a93a-819e-40e4-85f6-94e9ec3cac93 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-1233a93a-819e-40e4-85f6-94e9ec3cac93 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:52 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-1233a93a-819e-40e4-85f6-94e9ec3cac93 tempest-TaggedBootDevicesTest-516323745 None] Terminate volume connection completed successfully.
Sep 10 19:14:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-1233a93a-819e-40e4-85f6-94e9ec3cac93 tempest-TaggedBootDevicesTest-516323745 None] Deleting attachment 8d5677e8-2235-4b13-81ec-f3eff7ab066f. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:14:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-2c24f865-c9c1-4712-876b-6c735341ef74 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-2c24f865-c9c1-4712-876b-6c735341ef74 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:14:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-2c24f865-c9c1-4712-876b-6c735341ef74 tempest-TaggedBootDevicesTest-516323745 None] Terminate volume connection completed successfully.
Sep 10 19:14:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-fd2866d4-5a34-44b5-85e9-9bdaa9ea30ec req-2c24f865-c9c1-4712-876b-6c735341ef74 tempest-TaggedBootDevicesTest-516323745 None] Deleting attachment 8e813e79-f74a-44a1-9aa6-ca8417b11d8e. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:15:03 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:15:03 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-de59efd5-7ed8-46c7-86b8-14cb0f8526fd-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-de59efd5-7ed8-46c7-86b8-14cb0f8526fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-quobyte-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da93557-7466-4489-9633-f810d22906c3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:05 devstack quobyte-client[82905]: System call of process 88565 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" returned: 0 in 0.552s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" returned: 0 in 0.147s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-de59efd5-7ed8-46c7-86b8-14cb0f8526fd" released by "delete_volume" :: held 0.913s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Created reservations ['6684058f-b4fa-4b00-a927-631775025ce0', 'ea92b1cd-c67c-4d5a-b75c-d4ea90dde98e', '70d8e70a-c1e1-496a-b8c3-0886ca6700cb', '78cf9ac6-1920-4af3-bb98-b70338c38981'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.192s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-e1567207-7356-43ea-81ad-3c49c6feae27-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Deleted volume successfully.
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-e1567207-7356-43ea-81ad-3c49c6feae27-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2210209f-f412-4f5e-81c0-193696a97ac2 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-de59efd5-7ed8-46c7-86b8-14cb0f8526fd-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:07 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-quobyte-e1567207-7356-43ea-81ad-3c49c6feae27" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-e1567207-7356-43ea-81ad-3c49c6feae27" acquired by "delete_volume" :: waited 0.016s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fcb922-4f73-49eb-bbf5-4af78573f342]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27" returned: 0 in 0.516s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e1567207-7356-43ea-81ad-3c49c6feae27" returned: 0 in 0.323s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-e1567207-7356-43ea-81ad-3c49c6feae27" released by "delete_volume" :: held 1.002s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (8fca1ec3-a301-4e43-aa88-002cc4fdb4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7a10c3-2922-4deb-be3b-5bd3c018a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc7a10c3-2922-4deb-be3b-5bd3c018a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-478686143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98edfaec-876b-4a38-bfa2-220cf1b28b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:08Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41182b8e-6d46-45f6-a0e1-14e90d3a2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41182b8e-6d46-45f6-a0e1-14e90d3a2960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8938cd82-a3cf-4ea1-a072-5b5b24722996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8938cd82-a3cf-4ea1-a072-5b5b24722996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98edfaec-876b-4a38-bfa2-220cf1b28b7f', 'volume_name': 'volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53019881-d248-49f6-9b1d-34798c7a8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53019881-d248-49f6-9b1d-34798c7a8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d7271a-6ada-439c-90bb-54ee2dff073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:08 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Volume 98edfaec-876b-4a38-bfa2-220cf1b28b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f', 'volume_size': 1}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-478686143',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98edfaec-876b-4a38-bfa2-220cf1b28b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:08Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Creating volume 98edfaec-876b-4a38-bfa2-220cf1b28b7f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:15:08 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:08 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=23, name=volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Created reservations ['9a0531f4-332f-4211-a2cc-35447995146a', 'e0f0cd3d-48c2-4432-9342-0b34e118b6d5', 'fbcc8c54-2a11-44f9-8b78-7f85385aba82', '502966c0-afe3-4537-9d18-bc0a22585096'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f 1073741824" returned: 0 in 0.561s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f" returned: 0 in 0.325s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] <== create_volume: return (934ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d7271a-6ada-439c-90bb-54ee2dff073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f22b1d-e6dc-4cd2-9905-076f0b6601a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.140s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:09 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Deleted volume successfully.
Sep 10 19:15:09 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Volume volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f (98edfaec-876b-4a38-bfa2-220cf1b28b7f): created successfully
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f22b1d-e6dc-4cd2-9905-076f0b6601a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (8fca1ec3-a301-4e43-aa88-002cc4fdb4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a78fb565-820f-404c-b7a1-81f21fc0577c tempest-VolumesListAdminTestJSON-1354072390 None] Created volume successfully.
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f332d44f-5d57-42c8-b9c6-0afc1cd2c739 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-e1567207-7356-43ea-81ad-3c49c6feae27-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-962a7689-f03a-45ed-9087-79da5cf43c93-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-962a7689-f03a-45ed-9087-79da5cf43c93-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:10 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "cinder-quobyte-962a7689-f03a-45ed-9087-79da5cf43c93" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-962a7689-f03a-45ed-9087-79da5cf43c93" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57dd0be-5225-42a1-8b2c-756ab9631884]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:11 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:15:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (92dd811b-1b9e-4356-8366-b0cee4e2e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47187d4-4fa9-4de4-99b6-9c63f74fabbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 0.774s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47187d4-4fa9-4de4-99b6-9c63f74fabbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977604162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec52d1-14bc-4185-9e95-fbf697c740b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:11Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6769daa5-5379-4161-9a95-7fecc452bbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6769daa5-5379-4161-9a95-7fecc452bbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11d6d2c-9b55-4b2c-a1e4-56ed785b2516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11d6d2c-9b55-4b2c-a1e4-56ed785b2516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cec52d1-14bc-4185-9e95-fbf697c740b2', 'volume_name': 'volume-5cec52d1-14bc-4185-9e95-fbf697c740b2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d53f66-c2f8-4ac1-ae07-b6f276569fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d53f66-c2f8-4ac1-ae07-b6f276569fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e826a30-06b8-40c6-936b-081dd3fd6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:12 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Volume 5cec52d1-14bc-4185-9e95-fbf697c740b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cec52d1-14bc-4185-9e95-fbf697c740b2', 'volume_size': 1}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-977604162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cec52d1-14bc-4185-9e95-fbf697c740b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:11Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Creating volume 5cec52d1-14bc-4185-9e95-fbf697c740b2 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:15:12 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 1 in 0.738s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:12 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=24, name=volume-5cec52d1-14bc-4185-9e95-fbf697c740b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-962a7689-f03a-45ed-9087-79da5cf43c93" returned: 0 in 0.222s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-quobyte-962a7689-f03a-45ed-9087-79da5cf43c93" released by "delete_volume" :: held 2.135s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 1073741824" returned: 0 in 0.796s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2" returned: 0 in 0.311s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] <== create_volume: return (1195ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e826a30-06b8-40c6-936b-081dd3fd6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cec52d1-14bc-4185-9e95-fbf697c740b2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f20be4-85f6-4c75-813b-b96450643d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Created reservations ['7de20d4f-1c5e-466e-bb21-701ec426aea9', '416caffa-38f3-408c-b664-54b012715dc6', 'aa3d1a3b-2385-42b5-a4a5-38d42460ab8d', 'cc6d133c-48d4-4de4-a2b0-efcf2fc9c785'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:13 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Volume volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 (5cec52d1-14bc-4185-9e95-fbf697c740b2): created successfully
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71f20be4-85f6-4c75-813b-b96450643d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (92dd811b-1b9e-4356-8366-b0cee4e2e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-89670b10-67c5-4010-b614-9088df698ee5 tempest-VolumesListAdminTestJSON-1354072390 None] Created volume successfully.
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:13 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Deleted volume successfully.
Sep 10 19:15:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1619ad56-1005-48c1-ab3a-5fa83cab6244 tempest-TaggedBootDevicesTest-516323745 None] Lock "cinder-962a7689-f03a-45ed-9087-79da5cf43c93-delete_volume" released by "delete_volume" :: held 3.732s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:15 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (34cd1c80-ff59-421c-940e-2a241b473b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17e8b25-51c6-41db-986f-a2f372d655f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17e8b25-51c6-41db-986f-a2f372d655f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316494693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7a379c-4c30-4e38-bda4-64f435d535f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:16Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a0e6c1-c1ca-498f-9ba5-c0813670c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a0e6c1-c1ca-498f-9ba5-c0813670c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57eafc-457b-42f5-9dc4-d4ed98150255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc57eafc-457b-42f5-9dc4-d4ed98150255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7a379c-4c30-4e38-bda4-64f435d535f2', 'volume_name': 'volume-2a7a379c-4c30-4e38-bda4-64f435d535f2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9e536e-7e97-419f-8cb5-26249ac9acea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f9e536e-7e97-419f-8cb5-26249ac9acea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d173d49c-31e9-4119-bc32-7cf868e05d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:16 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Volume 2a7a379c-4c30-4e38-bda4-64f435d535f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7a379c-4c30-4e38-bda4-64f435d535f2', 'volume_size': 1}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1316494693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7a379c-4c30-4e38-bda4-64f435d535f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56098902b32743978ae0fe1a91133b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:16Z,use_quota=True,user_id='7e99bc7183fb4a9eb9472ee639f1b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Creating volume 2a7a379c-4c30-4e38-bda4-64f435d535f2 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:15:16 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:16 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=25, name=volume-2a7a379c-4c30-4e38-bda4-64f435d535f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 1073741824" returned: 0 in 0.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2" returned: 0 in 0.108s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] <== create_volume: return (612ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.626s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d173d49c-31e9-4119-bc32-7cf868e05d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7a379c-4c30-4e38-bda4-64f435d535f2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bba1cf-d83c-4c23-8189-01ff544e5149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Volume volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 (2a7a379c-4c30-4e38-bda4-64f435d535f2): created successfully
Sep 10 19:15:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bba1cf-d83c-4c23-8189-01ff544e5149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Flow 'volume_create_manager' (34cd1c80-ff59-421c-940e-2a241b473b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3e411fdf-04c0-420b-a44b-2f667614a05f tempest-VolumesListAdminTestJSON-1354072390 None] Created volume successfully.
Sep 10 19:15:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Flow 'volume_create_manager' (edbdf4c1-4351-4adf-b15b-711f9ae5e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df964a-37f5-44af-94dd-b20e35dca969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02df964a-37f5-44af-94dd-b20e35dca969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f7fcd3-7819-4d36-928b-c8b594a46c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1c1db8abde435380b3237a3723783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:19Z,use_quota=True,user_id='8f7ea335fb68485f96f983600cd00985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866f0ebd-9138-46af-a95c-2e0d563ddebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (866f0ebd-9138-46af-a95c-2e0d563ddebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dc2a0e-508d-4a42-ac0d-537203344dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7dc2a0e-508d-4a42-ac0d-537203344dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f7fcd3-7819-4d36-928b-c8b594a46c00', 'volume_name': 'volume-61f7fcd3-7819-4d36-928b-c8b594a46c00', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b34ad8-7297-43a1-ad71-cac0e39dd25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b34ad8-7297-43a1-ad71-cac0e39dd25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0ba300-bdc0-4788-bdf9-39ae041d92e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:18 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Volume 61f7fcd3-7819-4d36-928b-c8b594a46c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f7fcd3-7819-4d36-928b-c8b594a46c00', 'volume_size': 1}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f7fcd3-7819-4d36-928b-c8b594a46c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f1c1db8abde435380b3237a3723783f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:19Z,use_quota=True,user_id='8f7ea335fb68485f96f983600cd00985',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Creating volume 61f7fcd3-7819-4d36-928b-c8b594a46c00 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:15:18 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:15:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:19 devstack quobyte-client[82905]: System call of process 88597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:19 devstack quobyte-client[82905]: System call of process 88597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:19 devstack quobyte-client[82905]: System call of process 88597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:19 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=26, name=volume-61f7fcd3-7819-4d36-928b-c8b594a46c00, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 1073741824" returned: 0 in 0.453s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00" returned: 0 in 0.141s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] <== create_volume: return (677ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db0ba300-bdc0-4788-bdf9-39ae041d92e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f7fcd3-7819-4d36-928b-c8b594a46c00', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9435f75-11aa-458f-a7db-6a6ade140bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:19 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Volume volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 (61f7fcd3-7819-4d36-928b-c8b594a46c00): created successfully
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9435f75-11aa-458f-a7db-6a6ade140bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Flow 'volume_create_manager' (edbdf4c1-4351-4adf-b15b-711f9ae5e52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5d94cafc-5921-4691-8262-a69e4b4bf33d tempest-VolumesListAdminTestJSON-830823272 None] Created volume successfully.
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Acquiring lock "cinder-61f7fcd3-7819-4d36-928b-c8b594a46c00-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "cinder-61f7fcd3-7819-4d36-928b-c8b594a46c00-delete_volume" acquired by "delete_volume" :: waited 0.224s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:21 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-d70b5acf-8f4d-400d-9093-c69ab0715517 req-17d07045-f7f3-4d02-ab4d-600af34355b7 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:21 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-d70b5acf-8f4d-400d-9093-c69ab0715517 req-17d07045-f7f3-4d02-ab4d-600af34355b7 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-d70b5acf-8f4d-400d-9093-c69ab0715517 req-17d07045-f7f3-4d02-ab4d-600af34355b7 tempest-AttachVolumeNegativeTest-2110365285 None] Terminate volume connection completed successfully.
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-d70b5acf-8f4d-400d-9093-c69ab0715517 req-17d07045-f7f3-4d02-ab4d-600af34355b7 tempest-AttachVolumeNegativeTest-2110365285 None] Deleting attachment bf595645-89ae-4c73-8818-04a0c7a5d6de. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-2a7a379c-4c30-4e38-bda4-64f435d535f2-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:21 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Acquiring lock "cinder-quobyte-61f7fcd3-7819-4d36-928b-c8b594a46c00" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-2a7a379c-4c30-4e38-bda4-64f435d535f2-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "cinder-quobyte-61f7fcd3-7819-4d36-928b-c8b594a46c00" acquired by "delete_volume" :: waited 0.036s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f00487-1ee2-4a87-ac14-bbd7a6bb0e52]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-quobyte-2a7a379c-4c30-4e38-bda4-64f435d535f2" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-2a7a379c-4c30-4e38-bda4-64f435d535f2" acquired by "delete_volume" :: waited 0.068s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9313304-6d90-4984-83b2-99c9f4abb555]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00" returned: 0 in 0.989s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61f7fcd3-7819-4d36-928b-c8b594a46c00" returned: 0 in 0.322s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:23 devstack quobyte-client[82905]: System call of process 88604 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "cinder-quobyte-61f7fcd3-7819-4d36-928b-c8b594a46c00" released by "delete_volume" :: held 1.663s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2" returned: 0 in 1.128s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2a7a379c-4c30-4e38-bda4-64f435d535f2" returned: 0 in 0.352s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-2a7a379c-4c30-4e38-bda4-64f435d535f2" released by "delete_volume" :: held 1.610s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:24 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Created reservations ['58ade7b4-be67-4163-86a8-cf98f6f976d9', '20bec346-597d-4f0e-9151-271e575f61a4', '65a9b407-8bf2-4f8f-af06-3f49ab637a6d', '45224dee-19bf-45fd-9fd7-196c7877abf1'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:24 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Created reservations ['54fc745d-04ec-4166-a796-f3e9fde529c6', '2694cd9a-6d9f-42b6-b89e-e6e29444fdfc', 'bc1fcc94-700a-461c-bc5f-95bfebfe87b2', '8ff8015f-4cc4-4195-a27e-d60f8c0592f2'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.873s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-5cec52d1-14bc-4185-9e95-fbf697c740b2-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Deleted volume successfully.
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-89a8e26e-47f2-43c0-9072-5333b67c265f tempest-VolumesListAdminTestJSON-830823272 None] Lock "cinder-61f7fcd3-7819-4d36-928b-c8b594a46c00-delete_volume" released by "delete_volume" :: held 5.565s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-5cec52d1-14bc-4185-9e95-fbf697c740b2-delete_volume" acquired by "delete_volume" :: waited 0.807s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.655s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Deleted volume successfully.
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-231ec6de-8573-4cef-8620-c79fb9e6e184 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-2a7a379c-4c30-4e38-bda4-64f435d535f2-delete_volume" released by "delete_volume" :: held 5.417s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-quobyte-5cec52d1-14bc-4185-9e95-fbf697c740b2" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-5cec52d1-14bc-4185-9e95-fbf697c740b2" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba51d0-5c56-4e06-8542-4851b5f31631]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2" returned: 0 in 0.598s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cec52d1-14bc-4185-9e95-fbf697c740b2" returned: 0 in 0.273s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-5cec52d1-14bc-4185-9e95-fbf697c740b2" released by "delete_volume" :: held 1.168s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Created reservations ['c087f94d-4d1a-4515-8470-f60ea04fb558', '7da76410-0ece-4e5f-890e-5ec666a7de05', '5c7c3952-2b54-416a-8595-97b8c7a00c4c', '8877ad38-ede8-4ecf-baf0-d2ebb9d9b033'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:29 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Deleted volume successfully.
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-98edfaec-876b-4a38-bfa2-220cf1b28b7f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e9d9157-ec69-4aa1-809b-d8872845379e tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-5cec52d1-14bc-4185-9e95-fbf697c740b2-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-98edfaec-876b-4a38-bfa2-220cf1b28b7f-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:30 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "cinder-quobyte-98edfaec-876b-4a38-bfa2-220cf1b28b7f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-98edfaec-876b-4a38-bfa2-220cf1b28b7f" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8b0d5b-f17e-4f79-845c-5a8687653948]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f" returned: 0 in 0.661s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-98edfaec-876b-4a38-bfa2-220cf1b28b7f" returned: 0 in 0.115s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-quobyte-98edfaec-876b-4a38-bfa2-220cf1b28b7f" released by "delete_volume" :: held 0.990s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:31 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Created reservations ['7491acb6-bd04-47dc-8889-bf3e43369f2c', '003aac21-5e6e-4200-b986-eb5c092b4b1d', 'a9a082c8-b6ef-4ce0-a460-81863201de86', '59d50f47-7bee-4cd2-9487-1252bfe986e8'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.149s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:32 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Deleted volume successfully.
Sep 10 19:15:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1d2fd481-b696-4674-b37f-f461f0ab49f9 tempest-VolumesListAdminTestJSON-1354072390 None] Lock "cinder-98edfaec-876b-4a38-bfa2-220cf1b28b7f-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.155s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:36 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:15:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Flow 'volume_create_manager' (5d942b3b-9b48-48a2-8da3-19553929815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7192d09b-766d-453b-bc90-1d835b4eaefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7192d09b-766d-453b-bc90-1d835b4eaefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-235602085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc06742-e981-40d1-8a31-b79f4b608311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6517825b13bb41f78490b9e8a50fa546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:41Z,use_quota=True,user_id='c54b0626aaaf432d95a4963b5e8d0c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ee833-f959-4569-94d6-48c904dab15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0ee833-f959-4569-94d6-48c904dab15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa51824-f7c5-4c4f-872d-4361aa54e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fa51824-f7c5-4c4f-872d-4361aa54e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'afc06742-e981-40d1-8a31-b79f4b608311', 'volume_name': 'volume-afc06742-e981-40d1-8a31-b79f4b608311', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c4a60>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1f2a1-3627-4d58-92b1-a75825641bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab1f2a1-3627-4d58-92b1-a75825641bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e05dba-7022-4a12-b2ca-600a2a17fbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Volume afc06742-e981-40d1-8a31-b79f4b608311: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-afc06742-e981-40d1-8a31-b79f4b608311', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c4a60>}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Cloning afc06742-e981-40d1-8a31-b79f4b608311 from image be25800b-1081-46e6-8ee9-2b7d02b2963b  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:15:42 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26c0224-0a35-4417-b802-e265491c057b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:43 devstack sudo[88686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD
Sep 10 19:15:43 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:15:45 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root
Sep 10 19:15:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD" returned: 0 in 3.033s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:45 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b is fetched for user c54b0626aaaf432d95a4963b5e8d0c77. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:15:46 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd31433-4870-4ccb-a20d-e41cba2855fa]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:46 devstack sudo[88691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD
Sep 10 19:15:46 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:15:49 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD" returned: 0 in 3.297s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-235602085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc06742-e981-40d1-8a31-b79f4b608311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6517825b13bb41f78490b9e8a50fa546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:15:41Z,use_quota=True,user_id='c54b0626aaaf432d95a4963b5e8d0c77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Creating volume afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:15:49 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:15:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:49 devstack quobyte-client[82905]: System call of process 88697 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:49 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=27, name=volume-afc06742-e981-40d1-8a31-b79f4b608311, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 1073741824" returned: 0 in 0.605s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 0 in 0.172s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] <== create_volume: return (880ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:15:50 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Attempting download of be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume afc06742-e981-40d1-8a31-b79f4b608311. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:15:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[736d6435-e13e-449d-a91b-c37f3afb6eea]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_fpwz26nw {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_fpwz26nw" returned: 0 in 0.622s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_fpwz26nw {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_fpwz26nw" returned: 1 in 0.812s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_fpwz26nw' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:15:52 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f71ec7f-6b4e-4c23-a1a1-98b9e1f2ae1a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD" returned: 0 in 0.927s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:53 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] be25800b-1081-46e6-8ee9-2b7d02b2963b was qcow2, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:15:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:54 devstack quobyte-client[82905]: System call of process 88719 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:15:54 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=27, name=volume-afc06742-e981-40d1-8a31-b79f4b608311, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 0 in 2.019s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_01hs2ncddevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:15:56 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Converted 112.00 MB image at 54.00 MB/s
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 1G" returned: 0 in 0.242s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4556d1-5648-4cf1-8d02-8a992a4bb897]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:15:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 0 in 0.675s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 1 in 0.601s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Downloaded image be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume afc06742-e981-40d1-8a31-b79f4b608311 successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b for user c54b0626aaaf432d95a4963b5e8d0c77 is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:15:57 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Marking volume afc06742-e981-40d1-8a31-b79f4b608311 as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Copying metadata from image be25800b-1081-46e6-8ee9-2b7d02b2963b to afc06742-e981-40d1-8a31-b79f4b608311. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Creating volume glance metadata for volume afc06742-e981-40d1-8a31-b79f4b608311 backed by image be25800b-1081-46e6-8ee9-2b7d02b2963b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e05dba-7022-4a12-b2ca-600a2a17fbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc06742-e981-40d1-8a31-b79f4b608311', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171c4a60>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54da9af-8d43-4993-97e1-7bf8e03cafeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:15:58 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Volume volume-afc06742-e981-40d1-8a31-b79f4b608311 (afc06742-e981-40d1-8a31-b79f4b608311): created successfully
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54da9af-8d43-4993-97e1-7bf8e03cafeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:15:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Flow 'volume_create_manager' (5d942b3b-9b48-48a2-8da3-19553929815a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:15:58 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-492d1151-887e-4759-8771-7bbdd023ab66 tempest-VolumesImageMetadata-1260878083 None] Created volume successfully.
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Acquiring lock "cinder-afc06742-e981-40d1-8a31-b79f4b608311-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "cinder-afc06742-e981-40d1-8a31-b79f4b608311-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Acquiring lock "cinder-quobyte-afc06742-e981-40d1-8a31-b79f4b608311" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "cinder-quobyte-afc06742-e981-40d1-8a31-b79f4b608311" acquired by "delete_volume" :: waited 0.048s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d5555-590e-4a0e-b133-449d6fd9a7e6]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:16:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:02 devstack quobyte-client[82905]: System call of process 88775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:16:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 0 in 1.461s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 1 in 0.592s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:16:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-afc06742-e981-40d1-8a31-b79f4b608311" returned: 0 in 0.237s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "cinder-quobyte-afc06742-e981-40d1-8a31-b79f4b608311" released by "delete_volume" :: held 2.703s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:03 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=58,cinder:SELECT=44,cinder:INSERT=21,cinder:DELETE=9 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:03 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=58,cinder:INSERT=20,cinder:UPDATE=79,cinder:DELETE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Created reservations ['88c68e26-a9ce-40a0-bc80-34a2052d8bb5', 'b41ee58d-ffd1-4aba-88d9-cacfe2ae2c05', '4ad4d027-0733-457a-86c7-e3e1f2971509', '7220d9ec-9d77-4a1e-a1b4-0280e49f6491'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.393s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:05 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:16:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Deleted volume successfully.
Sep 10 19:16:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16ad4473-b687-444a-a459-112ce3e45ab9 tempest-VolumesImageMetadata-1260878083 None] Lock "cinder-afc06742-e981-40d1-8a31-b79f4b608311-delete_volume" released by "delete_volume" :: held 5.951s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:14 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:14 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:14 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Flow 'volume_create_manager' (3777a820-7a0d-4c66-af00-20dafbc08e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07078143-e7bb-442c-83d3-4983cbe8370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07078143-e7bb-442c-83d3-4983cbe8370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1102441319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9130a-471e-426e-b730-d640c537a0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b53a98dbe74092b67c30b15632abb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:15Z,use_quota=True,user_id='11e360d58ff1493b8fda479f50e207f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe0ceee-7a3c-49b7-bf0e-fe4004cd91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfe0ceee-7a3c-49b7-bf0e-fe4004cd91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ae9fc-5b49-44c4-997c-d707735c7ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094ae9fc-5b49-44c4-997c-d707735c7ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d9130a-471e-426e-b730-d640c537a0f8', 'volume_name': 'volume-87d9130a-471e-426e-b730-d640c537a0f8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8220c0ce-6716-407c-816d-c9c5e724c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8220c0ce-6716-407c-816d-c9c5e724c69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c53f03-1141-48a2-b072-f923279d2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:15 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Volume 87d9130a-471e-426e-b730-d640c537a0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d9130a-471e-426e-b730-d640c537a0f8', 'volume_size': 1}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1102441319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d9130a-471e-426e-b730-d640c537a0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b53a98dbe74092b67c30b15632abb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:15Z,use_quota=True,user_id='11e360d58ff1493b8fda479f50e207f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Creating volume 87d9130a-471e-426e-b730-d640c537a0f8 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:16:15 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:16:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:15 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=28, name=volume-87d9130a-471e-426e-b730-d640c537a0f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:16:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8 1073741824" returned: 0 in 0.917s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8" returned: 0 in 0.289s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] <== create_volume: return (1339ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:16:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c53f03-1141-48a2-b072-f923279d2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d9130a-471e-426e-b730-d640c537a0f8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc712a0-379f-41b2-ac41-595956fc60d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Volume volume-87d9130a-471e-426e-b730-d640c537a0f8 (87d9130a-471e-426e-b730-d640c537a0f8): created successfully
Sep 10 19:16:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbc712a0-379f-41b2-ac41-595956fc60d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Flow 'volume_create_manager' (3777a820-7a0d-4c66-af00-20dafbc08e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b32f7c35-d742-429c-b332-6f56ffeb6ff2 tempest-AbsoluteLimitsTests-1443017346 None] Created volume successfully.
Sep 10 19:16:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Acquiring lock "cinder-87d9130a-471e-426e-b730-d640c537a0f8-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "cinder-87d9130a-471e-426e-b730-d640c537a0f8-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Acquiring lock "cinder-quobyte-87d9130a-471e-426e-b730-d640c537a0f8" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "cinder-quobyte-87d9130a-471e-426e-b730-d640c537a0f8" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:19 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6cd565-7bb7-4574-824c-597de0f0e94c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:16:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8" returned: 0 in 0.726s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-87d9130a-471e-426e-b730-d640c537a0f8" returned: 0 in 0.156s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "cinder-quobyte-87d9130a-471e-426e-b730-d640c537a0f8" released by "delete_volume" :: held 1.202s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:20 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Created reservations ['5c679663-35c5-49cb-bcca-368b28303f14', '0693e521-48e9-4965-8729-4e1de2281851', '42ad8e71-660d-425b-aef0-63d6aa51ae7b', '292f8ee5-4da9-4a15-9b8c-3c7d4c5a6e53'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.170s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:16:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Deleted volume successfully.
Sep 10 19:16:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c76924b3-e4d8-4f2e-b169-718746291d65 tempest-AbsoluteLimitsTests-1443017346 None] Lock "cinder-87d9130a-471e-426e-b730-d640c537a0f8-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:30 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=9,cinder:INSERT=6,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:31 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:32 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Flow 'volume_create_manager' (26b25989-e945-4c61-86fa-2c2603b67baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b782d6-1603-47ba-aa85-0b42eaad1652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b782d6-1603-47ba-aa85-0b42eaad1652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950925241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bf8188-634a-4d2b-939f-4a18a8f1531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e3ba22c1bd4d53b2cd5d827946565e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:32Z,use_quota=True,user_id='084b0f4f63834e24b35286adb6e351f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46db4b6-963a-4526-ac31-e92bddd6d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46db4b6-963a-4526-ac31-e92bddd6d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bc6b2b-a09f-405f-bd48-3a75f9f73257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84bc6b2b-a09f-405f-bd48-3a75f9f73257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88bf8188-634a-4d2b-939f-4a18a8f1531f', 'volume_name': 'volume-88bf8188-634a-4d2b-939f-4a18a8f1531f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2037fe7c-9835-4889-9fee-d159d05b7fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2037fe7c-9835-4889-9fee-d159d05b7fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c0bbd-1d40-4c96-a71d-875dded2925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Volume 88bf8188-634a-4d2b-939f-4a18a8f1531f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88bf8188-634a-4d2b-939f-4a18a8f1531f', 'volume_size': 1}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-950925241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88bf8188-634a-4d2b-939f-4a18a8f1531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e3ba22c1bd4d53b2cd5d827946565e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:32Z,use_quota=True,user_id='084b0f4f63834e24b35286adb6e351f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Creating volume 88bf8188-634a-4d2b-939f-4a18a8f1531f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:16:32 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:16:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:33 devstack quobyte-client[82905]: System call of process 88891 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:16:33 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=29, name=volume-88bf8188-634a-4d2b-939f-4a18a8f1531f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f 1073741824" returned: 0 in 0.559s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f" returned: 0 in 0.169s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] <== create_volume: return (827ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6c0bbd-1d40-4c96-a71d-875dded2925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88bf8188-634a-4d2b-939f-4a18a8f1531f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63a905a-ed3d-4586-84c2-016c61884e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Volume volume-88bf8188-634a-4d2b-939f-4a18a8f1531f (88bf8188-634a-4d2b-939f-4a18a8f1531f): created successfully
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63a905a-ed3d-4586-84c2-016c61884e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Flow 'volume_create_manager' (26b25989-e945-4c61-86fa-2c2603b67baa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c7de7382-f2e5-4ab8-8e2d-1cc6a7284620 tempest-VolumesMetadataTest-695260749 None] Created volume successfully.
Sep 10 19:16:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Acquiring lock "cinder-88bf8188-634a-4d2b-939f-4a18a8f1531f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "cinder-88bf8188-634a-4d2b-939f-4a18a8f1531f-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Acquiring lock "cinder-quobyte-88bf8188-634a-4d2b-939f-4a18a8f1531f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "cinder-quobyte-88bf8188-634a-4d2b-939f-4a18a8f1531f" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272236a-a8df-4505-b2a4-6971e4125cd2]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f" returned: 0 in 0.420s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.029s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-88bf8188-634a-4d2b-939f-4a18a8f1531f" returned: 0 in 0.577s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "cinder-quobyte-88bf8188-634a-4d2b-939f-4a18a8f1531f" released by "delete_volume" :: held 1.206s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.386s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Created reservations ['b868c549-526d-43f0-b2b3-e0bca114eb72', '83d9d882-65ba-4385-80c7-0cbb23b5fe79', '4f14554a-a8e1-4ede-93c8-f2313d802c8c', '3e820dfd-c0b0-49b7-aff9-6da91fb43b03'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.138s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:16:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Deleted volume successfully.
Sep 10 19:16:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3583fa29-ea6b-4cee-946c-613390b5aaa2 tempest-VolumesMetadataTest-695260749 None] Lock "cinder-88bf8188-634a-4d2b-939f-4a18a8f1531f-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:16:47 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:48 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:16:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Flow 'volume_create_manager' (396c284a-a839-4b85-9685-b854d084cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35a7230-c204-4502-a5d0-ed6a222476b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35a7230-c204-4502-a5d0-ed6a222476b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1549389668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302e0e0-bfa5-4084-b920-a5020215ed1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e080fe491416eaeb102f9a8e32efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:51Z,use_quota=True,user_id='39b26971d72842f6a2d407aa958c1f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2642630a-c17f-4888-8e19-868a42d4e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2642630a-c17f-4888-8e19-868a42d4e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4c634c-c961-4bbf-bf88-cf3bc0cb7db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4c634c-c961-4bbf-bf88-cf3bc0cb7db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7302e0e0-bfa5-4084-b920-a5020215ed1a', 'volume_name': 'volume-7302e0e0-bfa5-4084-b920-a5020215ed1a', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51c115-342e-42d9-80b2-3bd775bd42a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab51c115-342e-42d9-80b2-3bd775bd42a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8728f66a-a8db-4913-a874-0f63ca62497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:51 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Volume 7302e0e0-bfa5-4084-b920-a5020215ed1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7302e0e0-bfa5-4084-b920-a5020215ed1a', 'volume_size': 1}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1549389668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302e0e0-bfa5-4084-b920-a5020215ed1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e080fe491416eaeb102f9a8e32efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:16:51Z,use_quota=True,user_id='39b26971d72842f6a2d407aa958c1f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Creating volume 7302e0e0-bfa5-4084-b920-a5020215ed1a {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:16:51 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:16:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:52 devstack quobyte-client[82905]: System call of process 89023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:16:52 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=30, name=volume-7302e0e0-bfa5-4084-b920-a5020215ed1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a 1073741824" returned: 0 in 1.357s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a" returned: 0 in 0.137s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] <== create_volume: return (1618ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8728f66a-a8db-4913-a874-0f63ca62497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7302e0e0-bfa5-4084-b920-a5020215ed1a', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c353daf-ead5-4477-852a-4ca92a71d6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:16:54 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Volume volume-7302e0e0-bfa5-4084-b920-a5020215ed1a (7302e0e0-bfa5-4084-b920-a5020215ed1a): created successfully
Sep 10 19:16:54 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c353daf-ead5-4477-852a-4ca92a71d6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:16:54 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Flow 'volume_create_manager' (396c284a-a839-4b85-9685-b854d084cd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:16:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5a3ac108-678e-4849-8249-1e11a11447aa tempest-VolumesTransfersTest-1409917291 None] Created volume successfully.
Sep 10 19:16:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a7b85e0f-b743-4a5e-bd55-1f0ca82dbbfe tempest-VolumesTransfersTest-1885841948 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a7b85e0f-b743-4a5e-bd55-1f0ca82dbbfe tempest-VolumesTransfersTest-1885841948 None] Transfer volume completed successfully.
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "cinder-7302e0e0-bfa5-4084-b920-a5020215ed1a-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-7302e0e0-bfa5-4084-b920-a5020215ed1a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "cinder-quobyte-7302e0e0-bfa5-4084-b920-a5020215ed1a" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-quobyte-7302e0e0-bfa5-4084-b920-a5020215ed1a" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6e8ea-3763-409b-9ee3-8f1365cdfbfe]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:16:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a" returned: 0 in 0.716s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:16:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7302e0e0-bfa5-4084-b920-a5020215ed1a" returned: 0 in 0.149s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:16:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-quobyte-7302e0e0-bfa5-4084-b920-a5020215ed1a" released by "delete_volume" :: held 1.137s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Created reservations ['c0b6d0f9-dce6-4ce2-9168-21f68708d8e1', 'b19c3d67-176c-49fb-aae1-cec062a91627', '54bbc766-c365-4c75-926f-5e93d527179a', '8b300723-bf3d-4db5-a56f-af4536418ab9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.126s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Deleted volume successfully.
Sep 10 19:17:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f10f54c7-cb4a-4c89-8425-5d6116e58bfd tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-7302e0e0-bfa5-4084-b920-a5020215ed1a-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Flow 'volume_create_manager' (3057be93-9978-4dbe-9a56-f23e09275942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791c9b6-f20e-44a8-8135-87cd5c0183e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b791c9b6-f20e-44a8-8135-87cd5c0183e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-412355113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709de9d9-dc5f-4423-80cd-f7bf469a3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e080fe491416eaeb102f9a8e32efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:01Z,use_quota=True,user_id='39b26971d72842f6a2d407aa958c1f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32112aa0-04d6-4e66-9c2e-941cf08564e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32112aa0-04d6-4e66-9c2e-941cf08564e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17a0c13-d590-46c9-bdf9-4c331db0cd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d17a0c13-d590-46c9-bdf9-4c331db0cd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709de9d9-dc5f-4423-80cd-f7bf469a3f7f', 'volume_name': 'volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d9bba5-f64b-4f45-bf51-6749bbd5cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d9bba5-f64b-4f45-bf51-6749bbd5cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e4fdb7-46fe-4558-b624-25157b932d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Volume 709de9d9-dc5f-4423-80cd-f7bf469a3f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f', 'volume_size': 1}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-412355113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709de9d9-dc5f-4423-80cd-f7bf469a3f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853e080fe491416eaeb102f9a8e32efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:01Z,use_quota=True,user_id='39b26971d72842f6a2d407aa958c1f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Creating volume 709de9d9-dc5f-4423-80cd-f7bf469a3f7f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:01 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:17:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:02 devstack quobyte-client[82905]: System call of process 89049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:02 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=31, name=volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f 1073741824" returned: 0 in 0.614s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" returned: 0 in 0.278s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] <== create_volume: return (1122ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e4fdb7-46fe-4558-b624-25157b932d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810ace57-3b24-44e2-a604-e558ac70d5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:03 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Volume volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f (709de9d9-dc5f-4423-80cd-f7bf469a3f7f): created successfully
Sep 10 19:17:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810ace57-3b24-44e2-a604-e558ac70d5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Flow 'volume_create_manager' (3057be93-9978-4dbe-9a56-f23e09275942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0a3f8c1c-626b-4567-935a-fce3cc971c8f tempest-VolumesTransfersTest-1409917291 None] Created volume successfully.
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "cinder-709de9d9-dc5f-4423-80cd-f7bf469a3f7f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-709de9d9-dc5f-4423-80cd-f7bf469a3f7f-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "cinder-quobyte-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-quobyte-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c6e6c-c8f2-4feb-a60a-047c87ea3db7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" returned: 0 in 0.553s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" returned: 0 in 0.222s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-quobyte-709de9d9-dc5f-4423-80cd-f7bf469a3f7f" released by "delete_volume" :: held 1.058s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Created reservations ['41822e59-71a0-4590-a828-a43a968911d0', '2443beff-5c4a-4bf9-8b68-e7eb6632715c', '4a1c0d6b-8c33-4b38-9b65-5577cfdb89b7', '24f427bf-6846-4300-881a-5f1c2efb843e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.126s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Deleted volume successfully.
Sep 10 19:17:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d760b1a9-7429-4d71-b804-0dd6a873962c tempest-VolumesTransfersTest-1521027470 None] Lock "cinder-709de9d9-dc5f-4423-80cd-f7bf469a3f7f-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:16 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=12,cinder:DELETE=3,cinder:INSERT=2,cinder:UPDATE=18 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:16 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=22,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:20 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Flow 'volume_create_manager' (df644177-8947-481d-ab5c-7bfdcdabe6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d820baca-9dff-4538-964e-cb4333e91a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d820baca-9dff-4538-964e-cb4333e91a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005860574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daefda7e-129d-410e-947a-6e0df0d14117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee141a318dae4572ac7276b709c0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:20Z,use_quota=True,user_id='7e1a70348bec450299458881b46510c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ff5f3-f182-4fb7-93c9-60e2b787caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3ff5f3-f182-4fb7-93c9-60e2b787caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05f3822-4ce5-4ca1-a2c1-769447de1964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05f3822-4ce5-4ca1-a2c1-769447de1964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daefda7e-129d-410e-947a-6e0df0d14117', 'volume_name': 'volume-daefda7e-129d-410e-947a-6e0df0d14117', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83314fc2-7497-4743-ac22-52eae7a1e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83314fc2-7497-4743-ac22-52eae7a1e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd092fd5-4f89-4d8c-8276-f907e254b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:20 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Volume daefda7e-129d-410e-947a-6e0df0d14117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daefda7e-129d-410e-947a-6e0df0d14117', 'volume_size': 1}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1005860574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daefda7e-129d-410e-947a-6e0df0d14117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee141a318dae4572ac7276b709c0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:20Z,use_quota=True,user_id='7e1a70348bec450299458881b46510c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Creating volume daefda7e-129d-410e-947a-6e0df0d14117 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:20 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:20 devstack quobyte-client[82905]: System call of process 89116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=32, name=volume-daefda7e-129d-410e-947a-6e0df0d14117, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117 1073741824" returned: 0 in 0.466s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117" returned: 0 in 0.245s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] <== create_volume: return (805ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd092fd5-4f89-4d8c-8276-f907e254b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daefda7e-129d-410e-947a-6e0df0d14117', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910e78f-a80c-4a23-9df4-0ab9347c3153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:21 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Volume volume-daefda7e-129d-410e-947a-6e0df0d14117 (daefda7e-129d-410e-947a-6e0df0d14117): created successfully
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9910e78f-a80c-4a23-9df4-0ab9347c3153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Flow 'volume_create_manager' (df644177-8947-481d-ab5c-7bfdcdabe6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e8cbe69b-eb37-41d0-9f83-ab749c9cfa25 tempest-VolumesTransfersV355Test-1292822578 None] Created volume successfully.
Sep 10 19:17:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:22 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (43464d12-6ab2-4f17-9c29-60bfc046f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab202c83-31fd-4315-8172-47794730647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab202c83-31fd-4315-8172-47794730647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1987193900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea1e531-cf50-4d53-af59-6ed4810f67ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:23Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ded868-ddc3-4541-af50-620ff41ae13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ded868-ddc3-4541-af50-620ff41ae13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c560e258-20c4-4047-87c9-26cc4d9a1939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c560e258-20c4-4047-87c9-26cc4d9a1939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea1e531-cf50-4d53-af59-6ed4810f67ea', 'volume_name': 'volume-dea1e531-cf50-4d53-af59-6ed4810f67ea', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15ef46d-e4f2-497c-828e-8ae928c8ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15ef46d-e4f2-497c-828e-8ae928c8ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7963c8e7-08d0-4732-a447-345bcfcf1d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:23 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Volume dea1e531-cf50-4d53-af59-6ed4810f67ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea1e531-cf50-4d53-af59-6ed4810f67ea', 'volume_size': 1}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1987193900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea1e531-cf50-4d53-af59-6ed4810f67ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:23Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Creating volume dea1e531-cf50-4d53-af59-6ed4810f67ea {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:23 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:23 devstack quobyte-client[82905]: System call of process 89122 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:23 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=33, name=volume-dea1e531-cf50-4d53-af59-6ed4810f67ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea 1073741824" returned: 0 in 0.633s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea" returned: 0 in 0.156s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] <== create_volume: return (949ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cc7005ae-00f5-481c-888e-f6ac0c1841df tempest-VolumesTransfersV355Test-2043158169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cc7005ae-00f5-481c-888e-f6ac0c1841df tempest-VolumesTransfersV355Test-2043158169 None] Transfer volume completed successfully.
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7963c8e7-08d0-4732-a447-345bcfcf1d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea1e531-cf50-4d53-af59-6ed4810f67ea', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57382ed-ec4e-4b20-8274-faf6ccb0f0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:24 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Volume volume-dea1e531-cf50-4d53-af59-6ed4810f67ea (dea1e531-cf50-4d53-af59-6ed4810f67ea): created successfully
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57382ed-ec4e-4b20-8274-faf6ccb0f0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (43464d12-6ab2-4f17-9c29-60bfc046f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0300a733-34fa-48cc-8b42-3bf4df17b6c0 tempest-AttachVolumeNegativeTest-2110365285 None] Created volume successfully.
Sep 10 19:17:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "cinder-daefda7e-129d-410e-947a-6e0df0d14117-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-daefda7e-129d-410e-947a-6e0df0d14117-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "cinder-quobyte-daefda7e-129d-410e-947a-6e0df0d14117" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-quobyte-daefda7e-129d-410e-947a-6e0df0d14117" acquired by "delete_volume" :: waited 0.026s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67625cc-b140-4862-a4e5-4f0b278bdf20]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117" returned: 0 in 0.532s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-daefda7e-129d-410e-947a-6e0df0d14117" returned: 0 in 0.144s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-quobyte-daefda7e-129d-410e-947a-6e0df0d14117" released by "delete_volume" :: held 0.916s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Created reservations ['c2412a59-d52a-453d-85bc-ab016982d270', '56d99233-cfb9-4927-b91d-e1bb7b33c761', '03262904-b0c3-4141-8040-5dca66b8a3ae', '33428c55-f664-4f17-bc2c-1ddc4854c590'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.148s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:27 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Deleted volume successfully.
Sep 10 19:17:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-800e3e22-54bd-4335-924c-70104c692936 tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-daefda7e-129d-410e-947a-6e0df0d14117-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:29 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Flow 'volume_create_manager' (13c0d204-c194-43b2-90f4-cf0421dfc249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828194a-d503-4a6a-bfc7-cfcc25eea9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828194a-d503-4a6a-bfc7-cfcc25eea9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-337331421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8ec182-2bec-4383-bec0-c1118c31e46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee141a318dae4572ac7276b709c0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:29Z,use_quota=True,user_id='7e1a70348bec450299458881b46510c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2c293-8bc4-4bf1-aa26-3411b5c83c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2c293-8bc4-4bf1-aa26-3411b5c83c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab01ce60-13f5-4009-8116-b30448942331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab01ce60-13f5-4009-8116-b30448942331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8ec182-2bec-4383-bec0-c1118c31e46a', 'volume_name': 'volume-4d8ec182-2bec-4383-bec0-c1118c31e46a', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8d598b-37ae-4d38-b4bc-ebbf073c1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8d598b-37ae-4d38-b4bc-ebbf073c1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ea8bc5-5792-4407-9969-69fb223416e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Volume 4d8ec182-2bec-4383-bec0-c1118c31e46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8ec182-2bec-4383-bec0-c1118c31e46a', 'volume_size': 1}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-337331421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8ec182-2bec-4383-bec0-c1118c31e46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee141a318dae4572ac7276b709c0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:29Z,use_quota=True,user_id='7e1a70348bec450299458881b46510c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Creating volume 4d8ec182-2bec-4383-bec0-c1118c31e46a {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:29 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:17:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:30 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=34, name=volume-4d8ec182-2bec-4383-bec0-c1118c31e46a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a 1073741824" returned: 0 in 0.479s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a" returned: 0 in 0.176s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] <== create_volume: return (696ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.501s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc341e4-f908-4d23-a991-2afa4c352606]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ea8bc5-5792-4407-9969-69fb223416e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8ec182-2bec-4383-bec0-c1118c31e46a', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95248285-eea7-47d8-86cd-d45b4c78bb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:31 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Volume volume-4d8ec182-2bec-4383-bec0-c1118c31e46a (4d8ec182-2bec-4383-bec0-c1118c31e46a): created successfully
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95248285-eea7-47d8-86cd-d45b4c78bb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Flow 'volume_create_manager' (13c0d204-c194-43b2-90f4-cf0421dfc249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0515a31a-2d61-43c4-9bb8-303e7af2d904 tempest-VolumesTransfersV355Test-1292822578 None] Created volume successfully.
Sep 10 19:17:31 devstack quobyte-client[82905]: System call of process 89170 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea" returned: 0 in 0.683s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-dea1e531-cf50-4d53-af59-6ed4810f67ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd74e6cf6-e394-4d2b-96d1-2427c301a25e', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:17:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-9ea7e126-92ea-4762-8004-24c333ba0900 req-c301820c-7904-4192-9165-5913ed7f44fb tempest-AttachVolumeNegativeTest-2110365285 None] attachment_update completed successfully.
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "cinder-4d8ec182-2bec-4383-bec0-c1118c31e46a-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-4d8ec182-2bec-4383-bec0-c1118c31e46a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:32 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "cinder-quobyte-4d8ec182-2bec-4383-bec0-c1118c31e46a" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-quobyte-4d8ec182-2bec-4383-bec0-c1118c31e46a" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ac3374-67cf-44f5-9671-66abf41a7696]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a" returned: 0 in 0.809s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d8ec182-2bec-4383-bec0-c1118c31e46a" returned: 0 in 0.226s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-quobyte-4d8ec182-2bec-4383-bec0-c1118c31e46a" released by "delete_volume" :: held 1.262s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Created reservations ['c22a911a-e35d-4995-87dd-ade3788fab3c', '3ccc3c56-bb02-45c7-82a2-3094604aaa01', '0114ddf9-7da7-4f02-b84f-f8add8efdce4', '247ce3bd-d47e-4146-bce0-4af0134e2547'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.167s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:34 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Deleted volume successfully.
Sep 10 19:17:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-223eb3c9-1255-44dd-ae76-29463ba348ac tempest-VolumesTransfersV355Test-1597770237 None] Lock "cinder-4d8ec182-2bec-4383-bec0-c1118c31e46a-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.217s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:17:43 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=30,cinder:DELETE=3,cinder:SELECT=22,cinder:INSERT=8 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:44 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:17:44 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:44 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Flow 'volume_create_manager' (a51cefd4-3993-45a4-82ea-6464fd9765c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9c4b4-1935-4703-881b-357aee01209d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9c4b4-1935-4703-881b-357aee01209d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1523251168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0654a4-66b0-4032-bfae-fee06e1c43ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4519e9b1d95647908ee4744be2601cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:44Z,use_quota=True,user_id='f72aff58634240499499adfdae8a8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54556542-7c7d-4bf7-87f3-0577bd61ba9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54556542-7c7d-4bf7-87f3-0577bd61ba9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e912086-b285-4a06-9eef-9e71180e212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e912086-b285-4a06-9eef-9e71180e212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c0654a4-66b0-4032-bfae-fee06e1c43ab', 'volume_name': 'volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c172209d0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af957e68-0779-4b8f-b67b-f58b1259e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af957e68-0779-4b8f-b67b-f58b1259e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05ab264-d77f-45de-8632-28896b261175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:45 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c172209d0>}
Sep 10 19:17:45 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Cloning 9c0654a4-66b0-4032-bfae-fee06e1c43ab from image be25800b-1081-46e6-8ee9-2b7d02b2963b  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:17:46 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:17:46 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:17:46 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc9550f-db33-4a84-9733-7078bb43f4bb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:46 devstack sudo[89597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD
Sep 10 19:17:46 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:17:48 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root
Sep 10 19:17:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD" returned: 0 in 2.708s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:48 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b is fetched for user f72aff58634240499499adfdae8a8926. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:17:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[502bcbea-3184-4adf-864b-b9d4b0fe5804]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:49 devstack sudo[89610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD
Sep 10 19:17:49 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:17:51 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD" returned: 0 in 2.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1523251168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0654a4-66b0-4032-bfae-fee06e1c43ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4519e9b1d95647908ee4744be2601cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:17:44Z,use_quota=True,user_id='f72aff58634240499499adfdae8a8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Creating volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:17:51 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:17:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:51 devstack quobyte-client[82905]: System call of process 89635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:51 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=35, name=volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 1073741824" returned: 0 in 0.424s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 0.120s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] <== create_volume: return (648ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Attempting download of be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e586a61b-8e73-4528-859b-eb30ae0687ec]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_b1o4d0ho {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_b1o4d0ho" returned: 0 in 0.453s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_b1o4d0ho {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_b1o4d0ho" returned: 1 in 0.439s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_b1o4d0ho' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580a97e-b212-4351-a030-ca4ad15dbe57]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:54 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] be25800b-1081-46e6-8ee9-2b7d02b2963b was qcow2, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:17:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:54 devstack quobyte-client[82905]: System call of process 89670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:54 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=35, name=volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:17:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 1.316s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:55 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_dmq6oowudevstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:17:55 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Converted 112.00 MB image at 83.45 MB/s
Sep 10 19:17:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:55 devstack quobyte-client[82905]: System call of process 89678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 1G" returned: 0 in 0.187s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b484f2-9b55-4296-b416-b9687760ee78]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 0.433s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:56 devstack quobyte-client[82905]: System call of process 89683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 1 in 0.473s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Downloaded image be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b for user f72aff58634240499499adfdae8a8926 is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Marking volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Copying metadata from image be25800b-1081-46e6-8ee9-2b7d02b2963b to 9c0654a4-66b0-4032-bfae-fee06e1c43ab. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Creating volume glance metadata for volume 9c0654a4-66b0-4032-bfae-fee06e1c43ab backed by image be25800b-1081-46e6-8ee9-2b7d02b2963b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a05ab264-d77f-45de-8632-28896b261175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c172209d0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39660cf-a6ed-4260-8d28-81868ef062dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:17:57 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Volume volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab (9c0654a4-66b0-4032-bfae-fee06e1c43ab): created successfully
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39660cf-a6ed-4260-8d28-81868ef062dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:17:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Flow 'volume_create_manager' (a51cefd4-3993-45a4-82ea-6464fd9765c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:17:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7f591c9c-51ac-4fef-8966-bb5346456658 tempest-VolumesExtendTest-687985313 None] Created volume successfully.
Sep 10 19:17:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5af7619-195c-4b02-b859-16f0bb3b5cb7]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 0.466s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 1 in 0.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:17:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 2G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:17:59 devstack quobyte-client[82905]: System call of process 89692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:17:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab 2G" returned: 0 in 0.171s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:17:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.307s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:17:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-95731386-229e-415e-991a-332dbd637d98 tempest-VolumesExtendTest-687985313 None] Extend volume completed successfully.
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-9c0654a4-66b0-4032-bfae-fee06e1c43ab-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "cinder-9c0654a4-66b0-4032-bfae-fee06e1c43ab-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Flow 'volume_create_manager' (ec79c9ea-cb56-456f-861a-c55d1774a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499a24f5-c485-4c2e-8156-bc44bb253d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-quobyte-9c0654a4-66b0-4032-bfae-fee06e1c43ab" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499a24f5-c485-4c2e-8156-bc44bb253d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-736794922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c3395-cba3-4399-82c6-4b6a3b46e538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7164bba88593452c9626497b29ee6b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:01Z,use_quota=True,user_id='2f24193bfa7b4355af0b4ef481f3b28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a7989b-2c90-484a-b054-9fe7cd238996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a7989b-2c90-484a-b054-9fe7cd238996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd0b94f-714d-494a-9046-fe07ddc3eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbd0b94f-714d-494a-9046-fe07ddc3eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466c3395-cba3-4399-82c6-4b6a3b46e538', 'volume_name': 'volume-466c3395-cba3-4399-82c6-4b6a3b46e538', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9598dc-ba01-4d20-8bdd-45f5b9c99c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9598dc-ba01-4d20-8bdd-45f5b9c99c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0409c9-72c9-48a0-9853-29c1886da863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume 466c3395-cba3-4399-82c6-4b6a3b46e538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466c3395-cba3-4399-82c6-4b6a3b46e538', 'volume_size': 1}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-736794922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466c3395-cba3-4399-82c6-4b6a3b46e538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7164bba88593452c9626497b29ee6b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:01Z,use_quota=True,user_id='2f24193bfa7b4355af0b4ef481f3b28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Creating volume 466c3395-cba3-4399-82c6-4b6a3b46e538 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:18:01 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:18:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:01 devstack quobyte-client[82905]: System call of process 89697 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:01 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=36, name=volume-466c3395-cba3-4399-82c6-4b6a3b46e538, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:18:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-9c0654a4-66b0-4032-bfae-fee06e1c43ab" acquired by "delete_volume" :: waited 0.597s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-3216f339-68f0-4839-8513-d8a7cfd0ee63 req-aa3efa85-fdbf-4db9-82af-f7ad9b55bdc3 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[facc875b-6706-4c23-9239-06457a9d2bae]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 1073741824" returned: 0 in 1.229s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:03 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-3216f339-68f0-4839-8513-d8a7cfd0ee63 req-aa3efa85-fdbf-4db9-82af-f7ad9b55bdc3 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-3216f339-68f0-4839-8513-d8a7cfd0ee63 req-aa3efa85-fdbf-4db9-82af-f7ad9b55bdc3 tempest-AttachVolumeNegativeTest-2110365285 None] Terminate volume connection completed successfully.
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-3216f339-68f0-4839-8513-d8a7cfd0ee63 req-aa3efa85-fdbf-4db9-82af-f7ad9b55bdc3 tempest-AttachVolumeNegativeTest-2110365285 None] Deleting attachment d74e6cf6-e394-4d2b-96d1-2427c301a25e. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538" returned: 0 in 0.403s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] <== create_volume: return (1691ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 0.876s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0409c9-72c9-48a0-9853-29c1886da863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466c3395-cba3-4399-82c6-4b6a3b46e538', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967d17bb-6c6e-453b-9b74-783facfc300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:04 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume volume-466c3395-cba3-4399-82c6-4b6a3b46e538 (466c3395-cba3-4399-82c6-4b6a3b46e538): created successfully
Sep 10 19:18:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967d17bb-6c6e-453b-9b74-783facfc300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Flow 'volume_create_manager' (ec79c9ea-cb56-456f-861a-c55d1774a53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c8809f16-6b84-4749-b204-274ececb27f5 tempest-AttachVolumeShelveTestJSON-683474098 None] Created volume successfully.
Sep 10 19:18:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 1 in 1.331s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:18:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9c0654a4-66b0-4032-bfae-fee06e1c43ab" returned: 0 in 0.445s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-9c0654a4-66b0-4032-bfae-fee06e1c43ab" released by "delete_volume" :: held 3.356s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Created reservations ['5ebc79e3-d349-4605-a1e9-ea72fe18695f', '5e84fb90-4fc9-4e51-8393-65c24db7738c', 'de27372c-e6b9-4e73-99d1-8c4c167d5ffa', 'd6ac6c57-b8bb-45be-9434-6cb730269775'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.293s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:18:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Deleted volume successfully.
Sep 10 19:18:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-22a5c2bd-e68e-4eb7-9477-d89669ab5e5e tempest-VolumesExtendTest-687985313 None] Lock "cinder-9c0654a4-66b0-4032-bfae-fee06e1c43ab-delete_volume" released by "delete_volume" :: held 6.457s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Flow 'volume_create_manager' (ee0499c5-f1f3-4f66-8354-6a60dd2ed1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4d469a-0190-4887-a5c2-8aaf0045ad39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4d469a-0190-4887-a5c2-8aaf0045ad39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617439731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5074ab-dbc7-4f8e-a29a-9337445dc684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4519e9b1d95647908ee4744be2601cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:08Z,use_quota=True,user_id='f72aff58634240499499adfdae8a8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c1dc1c-2886-452e-a389-9e834b7accf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c1dc1c-2886-452e-a389-9e834b7accf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b8791-f375-4fb7-9a00-627f74c9bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3b8791-f375-4fb7-9a00-627f74c9bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b5074ab-dbc7-4f8e-a29a-9337445dc684', 'volume_name': 'volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3814a497-ad36-4331-abb2-47661f1ae0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3814a497-ad36-4331-abb2-47661f1ae0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc98d63-e44a-47e3-8550-4ddec62309f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:08 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Volume 5b5074ab-dbc7-4f8e-a29a-9337445dc684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684', 'volume_size': 1}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1617439731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b5074ab-dbc7-4f8e-a29a-9337445dc684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4519e9b1d95647908ee4744be2601cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:08Z,use_quota=True,user_id='f72aff58634240499499adfdae8a8926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Creating volume 5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:18:08 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:18:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:09 devstack quobyte-client[82905]: System call of process 89785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:09 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=37, name=volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:18:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 1073741824" returned: 0 in 0.614s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.202s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] <== create_volume: return (995ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:18:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc98d63-e44a-47e3-8550-4ddec62309f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d00485-1a98-45cd-83ef-585a1fbf5e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:10 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Volume volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 (5b5074ab-dbc7-4f8e-a29a-9337445dc684): created successfully
Sep 10 19:18:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d00485-1a98-45cd-83ef-585a1fbf5e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Flow 'volume_create_manager' (ee0499c5-f1f3-4f66-8354-6a60dd2ed1a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-75deaaa8-8b0a-4f1c-b474-d18b5ef49bc1 tempest-VolumesExtendTest-687985313 None] Created volume successfully.
Sep 10 19:18:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Creating offline snapshot 23d7226c-955a-4a34-81fa-f83cd7c16702 of volume 5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:18:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de4d44c-bd3a-4ae1-9fe4-12388a7dee7b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.898s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:14 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=38, name=volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 1G" returned: 0 in 0.373s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img rebase -u -b volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.308s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.183s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:18:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.286s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.info" returned: 0 in 0.331s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:18:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.info" returned: 0 in 0.498s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.490s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:16 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-29be2ad6-e8f6-428e-86bb-8d495dcca2f5 tempest-VolumesExtendTest-687985313 None] Create snapshot completed successfully
Sep 10 19:18:17 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:17 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8bd71c-ad60-4405-bb7f-1298ff724330]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.654s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 2G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 2G" returned: 0 in 0.340s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.129s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-53b9616d-be97-4520-99b2-735a874d372d tempest-VolumesExtendTest-687985313 None] Extend volume completed successfully.
Sep 10 19:18:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-23d7226c-955a-4a34-81fa-f83cd7c16702-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-23d7226c-955a-4a34-81fa-f83cd7c16702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.131s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:20 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-quobyte-23d7226c-955a-4a34-81fa-f83cd7c16702" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-23d7226c-955a-4a34-81fa-f83cd7c16702" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Deleting offline snapshot 23d7226c-955a-4a34-81fa-f83cd7c16702 of volume 5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] snapshot_file for this snap is: volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabc412c-b56e-4b62-96c0-c92c226fc7b5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:20 devstack quobyte-client[82905]: System call of process 89857 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.632s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:18:21 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd714227-2846-4589-81df-20befe3ab3d8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.590s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:21 devstack quobyte-client[82905]: System call of process 89863 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.298s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684.23d7226c-955a-4a34-81fa-f83cd7c16702" returned: 0 in 0.195s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-23d7226c-955a-4a34-81fa-f83cd7c16702" released by "_delete_snapshot" :: held 2.327s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" released by "delete_snapshot" :: held 2.388s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:22 devstack cinder-volume[82863]: WARNING cinder.quota [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:18:22 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Created reservations ['617d7d21-4198-46f3-9fe1-9e9debaa2c7e', '1a29d552-211a-40ef-987c-d71f965c71c1', 'f450e30b-086b-475e-95de-e137a00f7699', '560f9803-bd75-4e1a-beb2-881c608517af'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:18:23 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Delete snapshot completed successfully.
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48b30bee-ff9f-4e46-9042-ecfa8e81fb43 tempest-VolumesExtendTest-687985313 None] Lock "cinder-23d7226c-955a-4a34-81fa-f83cd7c16702-delete_snapshot" released by "delete_snapshot" :: held 3.093s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-5b5074ab-dbc7-4f8e-a29a-9337445dc684-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "cinder-5b5074ab-dbc7-4f8e-a29a-9337445dc684-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:23 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Acquiring lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" acquired by "delete_volume" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3396cda2-ca46-4bd6-8177-3a0fcc79a735]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.693s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5b5074ab-dbc7-4f8e-a29a-9337445dc684" returned: 0 in 0.121s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "cinder-quobyte-5b5074ab-dbc7-4f8e-a29a-9337445dc684" released by "delete_volume" :: held 1.078s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Created reservations ['1b68c8cf-3315-4317-a81e-caa265666c25', 'c11f640e-f744-4ab5-bb71-89ecb1d3bf01', '8d7bcd87-2bf3-4920-b1e2-4e73ca5cdeea', 'c1e5c750-0dd2-4f49-a7b5-dccf655ece66'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.159s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:25 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:18:25 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Deleted volume successfully.
Sep 10 19:18:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3a8a7613-e224-494f-a4f0-9044f155fc86 tempest-VolumesExtendTest-687985313 None] Lock "cinder-5b5074ab-dbc7-4f8e-a29a-9337445dc684-delete_volume" released by "delete_volume" :: held 2.546s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:18:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Flow 'volume_create_manager' (16fdd320-b726-49ba-8e77-b5b2908c42bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c167b0-cb5d-48df-a081-7e2e389d3174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c167b0-cb5d-48df-a081-7e2e389d3174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1460928489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76706eb-f08a-4283-8dc5-eb64eb44b6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43eeb3a817e4d35b4a182990ac5e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:35Z,use_quota=True,user_id='1b40c0927c364e868bbb1ad635a2d807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a542f0f6-c8e4-436a-ac33-e25bb83e2669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a542f0f6-c8e4-436a-ac33-e25bb83e2669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8513bdd3-53e3-42e0-8b7f-e4c49c3240a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8513bdd3-53e3-42e0-8b7f-e4c49c3240a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76706eb-f08a-4283-8dc5-eb64eb44b6aa', 'volume_name': 'volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0e56be-0118-4832-8450-ef1a5440d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0e56be-0118-4832-8450-ef1a5440d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97358547-a1b5-492f-98e0-5d3da240f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:35 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Volume b76706eb-f08a-4283-8dc5-eb64eb44b6aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa', 'volume_size': 1}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1460928489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76706eb-f08a-4283-8dc5-eb64eb44b6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c43eeb3a817e4d35b4a182990ac5e17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:18:35Z,use_quota=True,user_id='1b40c0927c364e868bbb1ad635a2d807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Creating volume b76706eb-f08a-4283-8dc5-eb64eb44b6aa {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:18:35 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:18:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:36 devstack quobyte-client[82905]: System call of process 89880 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:18:36 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=40, name=volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:18:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:18:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa 1073741824" returned: 0 in 1.408s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.466s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" returned: 0 in 0.371s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] <== create_volume: return (1914ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:18:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97358547-a1b5-492f-98e0-5d3da240f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2505263c-f28a-467e-8a86-4034532e84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:18:38 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Volume volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa (b76706eb-f08a-4283-8dc5-eb64eb44b6aa): created successfully
Sep 10 19:18:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2505263c-f28a-467e-8a86-4034532e84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:18:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Flow 'volume_create_manager' (16fdd320-b726-49ba-8e77-b5b2908c42bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:18:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4f1eaeae-ea35-4519-8555-cb4114c86552 tempest-VolumesNegativeTest-1998775571 None] Created volume successfully.
Sep 10 19:18:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:18:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:18:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a4dba9-bb24-4873-8b5d-81981616d2b5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:18:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:18:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538" returned: 0 in 0.659s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:18:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.775s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:18:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-466c3395-cba3-4399-82c6-4b6a3b46e538', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8e60405-1b29-455c-a4f2-92abd0572988', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:18:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:18:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-6ee257c8-5460-4145-9e3d-d44f11c2cea4 req-ebd755c7-571e-437d-95ce-60a5fdfb151a tempest-AttachVolumeShelveTestJSON-683474098 None] attachment_update completed successfully.
Sep 10 19:18:51 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=36,cinder:SELECT=36,cinder:INSERT=8,cinder:DELETE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:18:51 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=39,cinder:INSERT=17,cinder:UPDATE=42,cinder:DELETE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.671s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Acquiring lock "cinder-b76706eb-f08a-4283-8dc5-eb64eb44b6aa-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "cinder-b76706eb-f08a-4283-8dc5-eb64eb44b6aa-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:19:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Acquiring lock "cinder-quobyte-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "cinder-quobyte-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b951de9-c7ad-45fb-9369-054d8891d7ac]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:19:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" returned: 0 in 0.524s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" returned: 0 in 0.174s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "cinder-quobyte-b76706eb-f08a-4283-8dc5-eb64eb44b6aa" released by "delete_volume" :: held 0.919s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Created reservations ['700f846e-bd4b-4207-af88-36cc476becc7', '6ba60f7e-5b3c-430e-9acd-47478d3cc92b', '0defaa0d-8b3e-481b-aab1-858ca04145b1', 'bc707bfa-a7a8-4076-b164-41e1f5746e6e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:19:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Deleted volume successfully.
Sep 10 19:19:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a7ade3ba-8d37-4806-8456-cd4106ff48a3 tempest-VolumesNegativeTest-1998775571 None] Lock "cinder-b76706eb-f08a-4283-8dc5-eb64eb44b6aa-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:20:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:08 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:20:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (6effac44-5e00-4060-aa52-ac0d7f702b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:20:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4ffd06-4723-48c7-9f32-a65525d0e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f4ffd06-4723-48c7-9f32-a65525d0e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1230257157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c268d2-3d37-4f9b-a9e3-974a82f459f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:20:08Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698d79ab-d14f-44d4-89ce-dcf1182af009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698d79ab-d14f-44d4-89ce-dcf1182af009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbedf2cb-2adc-4a2c-8ed6-45eea1e730cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbedf2cb-2adc-4a2c-8ed6-45eea1e730cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c268d2-3d37-4f9b-a9e3-974a82f459f5', 'volume_name': 'volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4e94cd-c8e0-4155-9c62-b27666a896fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4e94cd-c8e0-4155-9c62-b27666a896fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6cff59-169d-4aa2-a39c-94125841c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:10 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Volume 17c268d2-3d37-4f9b-a9e3-974a82f459f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5', 'volume_size': 1}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1230257157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c268d2-3d37-4f9b-a9e3-974a82f459f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3eae16a8bb54ea28befdf5323dcf646',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:20:08Z,use_quota=True,user_id='4d6e7df9184c4372be0383eb8023228c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Creating volume 17c268d2-3d37-4f9b-a9e3-974a82f459f5 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:20:10 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:20:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:11 devstack quobyte-client[82905]: System call of process 90838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:20:11 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=41, name=volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:20:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 1073741824" returned: 0 in 1.213s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5" returned: 0 in 0.469s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] <== create_volume: return (2092ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:20:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:14 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6cff59-169d-4aa2-a39c-94125841c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:14 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6dde44-da03-4caf-9e78-dd7b50bfb301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:20:14 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Volume volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 (17c268d2-3d37-4f9b-a9e3-974a82f459f5): created successfully
Sep 10 19:20:14 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6dde44-da03-4caf-9e78-dd7b50bfb301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:20:14 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Flow 'volume_create_manager' (6effac44-5e00-4060-aa52-ac0d7f702b72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:20:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-84956cfa-874e-49f3-8f7a-a2b22e52b906 tempest-AttachVolumeNegativeTest-2110365285 None] Created volume successfully.
Sep 10 19:20:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:20 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b2300a-3eb7-4bd0-bc75-931f37b237ac]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:20:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5" returned: 0 in 0.829s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.972s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d22d203-3371-44a8-a741-203de34b678a', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:20:21 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-9928db03-ef63-4032-9293-708c7f1051c0 req-798c92eb-b63a-46d8-8f29-7fa3aacaff52 tempest-AttachVolumeNegativeTest-2110365285 None] attachment_update completed successfully.
Sep 10 19:20:31 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:31 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=1,cinder:UPDATE=5 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:20:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:20:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.262s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:20:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:20:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-057ab2f3-2d33-4502-ad3c-22b73fd3ba71 req-9328430b-80b3-4df7-9254-cc567363c822 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-057ab2f3-2d33-4502-ad3c-22b73fd3ba71 req-9328430b-80b3-4df7-9254-cc567363c822 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:20:50 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-057ab2f3-2d33-4502-ad3c-22b73fd3ba71 req-9328430b-80b3-4df7-9254-cc567363c822 tempest-AttachVolumeNegativeTest-2110365285 None] Terminate volume connection completed successfully.
Sep 10 19:20:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-057ab2f3-2d33-4502-ad3c-22b73fd3ba71 req-9328430b-80b3-4df7-9254-cc567363c822 tempest-AttachVolumeNegativeTest-2110365285 None] Deleting attachment 1d22d203-3371-44a8-a741-203de34b678a. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:21:00 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:00 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-17c268d2-3d37-4f9b-a9e3-974a82f459f5-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-17c268d2-3d37-4f9b-a9e3-974a82f459f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-quobyte-17c268d2-3d37-4f9b-a9e3-974a82f459f5" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-17c268d2-3d37-4f9b-a9e3-974a82f459f5" acquired by "delete_volume" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63c3820-2b5c-46a4-a827-29a16ee32486]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:21:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5" returned: 0 in 0.456s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-17c268d2-3d37-4f9b-a9e3-974a82f459f5" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-17c268d2-3d37-4f9b-a9e3-974a82f459f5" released by "delete_volume" :: held 0.718s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:07 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Created reservations ['0157669d-0535-4792-8e74-ddf8d400f81c', '62b2bd49-e509-4504-8a53-be33160b6bbb', '7cfa4f3f-212a-4f30-b4bf-218acbe745d4', '7b271ebc-049f-4418-ad4e-ecb563ff2064'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.183s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:21:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Deleted volume successfully.
Sep 10 19:21:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4351aad6-384a-4139-83c5-1829f02a3cc5 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-17c268d2-3d37-4f9b-a9e3-974a82f459f5-delete_volume" released by "delete_volume" :: held 2.008s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-dea1e531-cf50-4d53-af59-6ed4810f67ea-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-dea1e531-cf50-4d53-af59-6ed4810f67ea-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-quobyte-dea1e531-cf50-4d53-af59-6ed4810f67ea" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-dea1e531-cf50-4d53-af59-6ed4810f67ea" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c56125-42de-4bfa-bfa6-b463ca48da79]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:21:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea" returned: 0 in 1.620s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-0a6368c3-5e23-491e-a608-a37e9ebf6a57 req-da89002e-9962-456f-bc73-d9fe2e3f7168 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dea1e531-cf50-4d53-af59-6ed4810f67ea" returned: 0 in 1.767s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-dea1e531-cf50-4d53-af59-6ed4810f67ea" released by "delete_volume" :: held 3.864s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:13 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-0a6368c3-5e23-491e-a608-a37e9ebf6a57 req-da89002e-9962-456f-bc73-d9fe2e3f7168 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-0a6368c3-5e23-491e-a608-a37e9ebf6a57 req-da89002e-9962-456f-bc73-d9fe2e3f7168 tempest-AttachVolumeShelveTestJSON-683474098 None] Terminate volume connection completed successfully.
Sep 10 19:21:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-0a6368c3-5e23-491e-a608-a37e9ebf6a57 req-da89002e-9962-456f-bc73-d9fe2e3f7168 tempest-AttachVolumeShelveTestJSON-683474098 None] Deleting attachment c8e60405-1b29-455c-a4f2-92abd0572988. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:21:13 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Created reservations ['84f57ee3-8aae-4012-814c-76c9bf17c014', 'de3051de-74d3-491b-828d-8448d2b1ba2d', 'a8f6e574-9deb-4017-b5d0-74237579782d', '961f38c1-581a-40e4-b5a8-87675dcbf59f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.161s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:14 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:21:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Deleted volume successfully.
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e433b532-6548-475a-adcb-cbae2a488a82 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-dea1e531-cf50-4d53-af59-6ed4810f67ea-delete_volume" released by "delete_volume" :: held 5.758s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "cinder-quobyte-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3c1f45-b4aa-4c83-a0a6-40dab3193d7b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:21:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:16 devstack quobyte-client[82905]: System call of process 91124 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:21:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" returned: 0 in 1.267s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" returned: 0 in 0.211s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-quobyte-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa" released by "delete_volume" :: held 2.232s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:19 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Created reservations ['626c451b-68e9-40ca-a03c-7a1a4afdf938', '3822bc5b-9a57-468d-8864-47a32a34c063', 'a16f6958-4d48-4c3f-bf6e-641e5586d520', '0b9f7268-2f40-435a-813e-d7d23cb4cde8'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:21:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.276s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:20 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:21:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Deleted volume successfully.
Sep 10 19:21:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2283f35-41b6-4d98-9da6-d53728f9d212 tempest-AttachVolumeNegativeTest-2110365285 None] Lock "cinder-ef4ea392-0827-4f3b-ac8c-6d8c651b3efa-delete_volume" released by "delete_volume" :: held 5.877s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:21:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Flow 'volume_create_manager' (067db0ed-dc7d-4e53-a6ee-4000a8ba046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c879b-0d02-4ea9-b188-33743931be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69c879b-0d02-4ea9-b188-33743931be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-146343782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b63e50-10b6-4cef-a752-19fcb01b81de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a01033c47d74c5187d3645e29d22082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:21:26Z,use_quota=True,user_id='923a264c0a5441f1b1bd7f0121af475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3443679-322f-4266-a2da-4ccb13d5a399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3443679-322f-4266-a2da-4ccb13d5a399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b658e0-bbfc-427e-a686-5f15744b90e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b658e0-bbfc-427e-a686-5f15744b90e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b63e50-10b6-4cef-a752-19fcb01b81de', 'volume_name': 'volume-90b63e50-10b6-4cef-a752-19fcb01b81de', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca75d7-1dfc-4296-a048-c40b90e9669c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ca75d7-1dfc-4296-a048-c40b90e9669c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b619f6a-98b7-4e54-a82a-f85ac0106859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:26 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Volume 90b63e50-10b6-4cef-a752-19fcb01b81de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b63e50-10b6-4cef-a752-19fcb01b81de', 'volume_size': 1}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-146343782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b63e50-10b6-4cef-a752-19fcb01b81de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a01033c47d74c5187d3645e29d22082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:21:26Z,use_quota=True,user_id='923a264c0a5441f1b1bd7f0121af475b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Creating volume 90b63e50-10b6-4cef-a752-19fcb01b81de {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:21:26 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:21:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:27 devstack quobyte-client[82905]: System call of process 91174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:21:27 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=42, name=volume-90b63e50-10b6-4cef-a752-19fcb01b81de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:21:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de 1073741824" returned: 0 in 0.764s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de" returned: 0 in 0.180s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] <== create_volume: return (1069ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:21:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b619f6a-98b7-4e54-a82a-f85ac0106859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b63e50-10b6-4cef-a752-19fcb01b81de', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bd845-f03d-4fc5-9511-9d9d2f9f90cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:21:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Volume volume-90b63e50-10b6-4cef-a752-19fcb01b81de (90b63e50-10b6-4cef-a752-19fcb01b81de): created successfully
Sep 10 19:21:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16bd845-f03d-4fc5-9511-9d9d2f9f90cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:21:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Flow 'volume_create_manager' (067db0ed-dc7d-4e53-a6ee-4000a8ba046f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:21:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-32439cec-f34c-45f6-bc4b-720ee280b984 tempest-TestMinimumBasicScenario-1463242741 None] Created volume successfully.
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3913d-e3b4-49e5-abea-54eb9a45dfd3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:21:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.308s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:21:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de" returned: 0 in 1.642s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:21:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.793s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:21:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-90b63e50-10b6-4cef-a752-19fcb01b81de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '47c23e92-6cee-442a-a09a-1f0ec31628ec', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:21:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:21:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-e18ee555-f3c6-4b1b-842f-5cd619138262 req-8b951d49-2d18-44c4-afb5-eec3b040cd76 tempest-TestMinimumBasicScenario-1463242741 None] attachment_update completed successfully.
Sep 10 19:21:48 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=23,cinder:SELECT=26,cinder:INSERT=5,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:48 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:21:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f405ebec-065b-4c86-b5cd-aa96e38b1da5 tempest-BackendsCapabilitiesAdminTestsJSON-100530078 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 19:21:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5189c74d-b9f4-4b5e-9e93-890db52fc60d tempest-BackendsCapabilitiesAdminTestsJSON-100530078 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82863) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 10 19:22:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:22:30 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9dd15a7a-7f7b-44cd-a511-c6f713ac47e5 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9dd15a7a-7f7b-44cd-a511-c6f713ac47e5 tempest-GroupsTest-1091361080 None] Group tempest-Group1-689240823: creating
Sep 10 19:22:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9dd15a7a-7f7b-44cd-a511-c6f713ac47e5 tempest-GroupsTest-1091361080 None] Group tempest-Group1-689240823: created successfully
Sep 10 19:22:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9dd15a7a-7f7b-44cd-a511-c6f713ac47e5 tempest-GroupsTest-1091361080 None] Create group completed successfully.
Sep 10 19:22:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2b745651-5152-4ed0-874b-6160992e4b84 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2b745651-5152-4ed0-874b-6160992e4b84 tempest-GroupsTest-1091361080 None] Group tempest-Group2-1297840639: creating
Sep 10 19:22:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2b745651-5152-4ed0-874b-6160992e4b84 tempest-GroupsTest-1091361080 None] Group tempest-Group2-1297840639: created successfully
Sep 10 19:22:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2b745651-5152-4ed0-874b-6160992e4b84 tempest-GroupsTest-1091361080 None] Create group completed successfully.
Sep 10 19:22:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (4b9fb683-896c-4e62-99c5-62a7121ae631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800e51fd-3018-490c-b73a-0d2194199252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (800e51fd-3018-490c-b73a-0d2194199252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440479561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e8c1326-745d-4b74-bee1-6b713e17886f,host='devstack@QuobyteHD#QuobyteHD',id=91ca1f98-e502-4d32-b20e-14206b9ecb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:34Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe6c8fce-e92f-492c-8256-67891d22ef73),volume_type_id=fe6c8fce-e92f-492c-8256-67891d22ef73)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53d1909-0488-4cc0-86ff-4c9251bfbda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53d1909-0488-4cc0-86ff-4c9251bfbda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7350d1-ed66-4ba0-a055-866fa5dd31b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f7350d1-ed66-4ba0-a055-866fa5dd31b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ca1f98-e502-4d32-b20e-14206b9ecb43', 'volume_name': 'volume-91ca1f98-e502-4d32-b20e-14206b9ecb43', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a05883-a4f5-4968-84ab-1b6886f29fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a05883-a4f5-4968-84ab-1b6886f29fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2a91d3-8877-4571-a0d8-bed431eaf59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:34 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Volume 91ca1f98-e502-4d32-b20e-14206b9ecb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ca1f98-e502-4d32-b20e-14206b9ecb43', 'volume_size': 1}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e8c1326-745d-4b74-bee1-6b713e17886f,created_at=2025-09-10T17:22:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-440479561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e8c1326-745d-4b74-bee1-6b713e17886f,host='devstack@QuobyteHD#QuobyteHD',id=91ca1f98-e502-4d32-b20e-14206b9ecb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:34Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fe6c8fce-e92f-492c-8256-67891d22ef73),volume_type_id=fe6c8fce-e92f-492c-8256-67891d22ef73)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Creating volume 91ca1f98-e502-4d32-b20e-14206b9ecb43 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:34 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:22:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:34 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=43, name=volume-91ca1f98-e502-4d32-b20e-14206b9ecb43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:22:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 1073741824" returned: 0 in 0.785s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43" returned: 0 in 0.161s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] <== create_volume: return (1354ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2a91d3-8877-4571-a0d8-bed431eaf59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ca1f98-e502-4d32-b20e-14206b9ecb43', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3671b-7ec2-4c90-be56-952387d13a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Volume volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 (91ca1f98-e502-4d32-b20e-14206b9ecb43): created successfully
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e3671b-7ec2-4c90-be56-952387d13a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (4b9fb683-896c-4e62-99c5-62a7121ae631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:36 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1298af11-c629-4239-99b7-3399ecb3114a tempest-GroupsTest-1091361080 None] Created volume successfully.
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.382s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:22:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Acquiring lock "cinder-quobyte-91ca1f98-e502-4d32-b20e-14206b9ecb43" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:22:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-91ca1f98-e502-4d32-b20e-14206b9ecb43" acquired by "delete_volume" :: waited 0.134s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:22:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcace5c-1232-4f38-8f95-1dde890d3a01]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:22:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43" returned: 0 in 0.446s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-91ca1f98-e502-4d32-b20e-14206b9ecb43" returned: 0 in 0.173s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-91ca1f98-e502-4d32-b20e-14206b9ecb43" released by "delete_volume" :: held 0.821s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Created reservations ['7b8c215b-5343-4a49-9c4a-cabf967020e7'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:22:41 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-741271939 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-741271939, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:22:41 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-741271939 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-741271939, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Created reservations ['993c032d-e6ea-4c1e-88eb-8f9c3c68b78c', '10a693a4-8213-4e7b-93db-3a607004d937', '9dd0f69c-99c1-4b9f-bb31-54de469c20a7', '1e6d17ba-9e7d-4beb-9cb7-90d55b012b17'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.166s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:41 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:22:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cc347de5-ab5e-4a14-ba5a-f844a4955ab9 tempest-GroupsTest-1091361080 None] Delete group completed successfully.
Sep 10 19:22:44 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Created reservations ['e677d0eb-a048-4007-90be-cf0bc1d99cf2'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.131s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:45 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:22:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b389bacc-673d-4ca3-a2e8-a08c24f81b98 tempest-GroupsTest-1091361080 None] Delete group completed successfully.
Sep 10 19:22:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-dec4aaae-8fd4-4ada-997b-89c23247eef7 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-dec4aaae-8fd4-4ada-997b-89c23247eef7 tempest-GroupsTest-1091361080 None] Group tempest-GroupsTest-Group-1549755607: creating
Sep 10 19:22:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-dec4aaae-8fd4-4ada-997b-89c23247eef7 tempest-GroupsTest-1091361080 None] Group tempest-GroupsTest-Group-1549755607: created successfully
Sep 10 19:22:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-dec4aaae-8fd4-4ada-997b-89c23247eef7 tempest-GroupsTest-1091361080 None] Create group completed successfully.
Sep 10 19:22:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:50 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (c8e5518d-8b45-4346-9a0c-6280132e7113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb31498-6b0e-46ec-96d4-343bd0ee7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb31498-6b0e-46ec-96d4-343bd0ee7254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723143149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0e422001-e74e-4473-94f7-d54f35bbe23d,host='devstack@QuobyteHD#QuobyteHD',id=93dde4cb-619f-40ae-a2e5-f7b90a60fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:50Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bb7050a-38dc-4aea-8a5b-2383be2118fc),volume_type_id=8bb7050a-38dc-4aea-8a5b-2383be2118fc)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27d6086-13e0-49b6-b7cf-3627433c7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e27d6086-13e0-49b6-b7cf-3627433c7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f0e899-4c5a-41b7-81df-9dd9b1080711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12f0e899-4c5a-41b7-81df-9dd9b1080711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93dde4cb-619f-40ae-a2e5-f7b90a60fde7', 'volume_name': 'volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75ebe31-c67e-4f52-a951-6c3f36e4c9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75ebe31-c67e-4f52-a951-6c3f36e4c9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc74fa7c-dbd9-4e33-b078-40a4ab2008aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:51 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Volume 93dde4cb-619f-40ae-a2e5-f7b90a60fde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7', 'volume_size': 1}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0e422001-e74e-4473-94f7-d54f35bbe23d,created_at=2025-09-10T17:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723143149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0e422001-e74e-4473-94f7-d54f35bbe23d,host='devstack@QuobyteHD#QuobyteHD',id=93dde4cb-619f-40ae-a2e5-f7b90a60fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:50Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bb7050a-38dc-4aea-8a5b-2383be2118fc),volume_type_id=8bb7050a-38dc-4aea-8a5b-2383be2118fc)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Creating volume 93dde4cb-619f-40ae-a2e5-f7b90a60fde7 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:51 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:22:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:52 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=44, name=volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:22:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 1073741824" returned: 0 in 0.782s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" returned: 0 in 0.329s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] <== create_volume: return (1539ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc74fa7c-dbd9-4e33-b078-40a4ab2008aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43515b9a-6888-4736-bb79-5fee98129172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:53 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Volume volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 (93dde4cb-619f-40ae-a2e5-f7b90a60fde7): created successfully
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43515b9a-6888-4736-bb79-5fee98129172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (c8e5518d-8b45-4346-9a0c-6280132e7113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c04951a0-4690-4678-81b6-59472aefd451 tempest-GroupsTest-1091361080 None] Created volume successfully.
Sep 10 19:22:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (727a2bba-ce36-4db0-bf74-8e0663a05eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31472b1e-2433-4622-8450-188ccceb6a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31472b1e-2433-4622-8450-188ccceb6a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400065664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0e422001-e74e-4473-94f7-d54f35bbe23d,host='devstack@QuobyteHD#QuobyteHD',id=a3c4c5f3-e7a5-431b-a5dc-000939a21c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:56Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bb7050a-38dc-4aea-8a5b-2383be2118fc),volume_type_id=8bb7050a-38dc-4aea-8a5b-2383be2118fc)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84eaa9e0-42eb-493e-843b-5efb0e9a7cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84eaa9e0-42eb-493e-843b-5efb0e9a7cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2c745b-62c5-429f-932f-9ab33db51323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2c745b-62c5-429f-932f-9ab33db51323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c4c5f3-e7a5-431b-a5dc-000939a21c67', 'volume_name': 'volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0a246-2b1b-4980-ad4e-d71e2f136833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c0a246-2b1b-4980-ad4e-d71e2f136833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b2729-0b1e-4f8d-8e3e-11195b318045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:56 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Volume a3c4c5f3-e7a5-431b-a5dc-000939a21c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67', 'volume_size': 1}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0e422001-e74e-4473-94f7-d54f35bbe23d,created_at=2025-09-10T17:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-400065664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0e422001-e74e-4473-94f7-d54f35bbe23d,host='devstack@QuobyteHD#QuobyteHD',id=a3c4c5f3-e7a5-431b-a5dc-000939a21c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1f6e09056de4df29c297826cf2046f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:22:56Z,use_quota=True,user_id='cf74a0b4e1c44ef0b384a5e0aad6c2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8bb7050a-38dc-4aea-8a5b-2383be2118fc),volume_type_id=8bb7050a-38dc-4aea-8a5b-2383be2118fc)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Creating volume a3c4c5f3-e7a5-431b-a5dc-000939a21c67 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:22:56 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:22:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:57 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=45, name=volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:22:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 1073741824" returned: 0 in 0.881s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:22:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" returned: 0 in 0.530s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:22:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] <== create_volume: return (1689ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:22:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:22:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b2729-0b1e-4f8d-8e3e-11195b318045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4507b893-e57a-4586-ac6f-019b75837931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:22:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Volume volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 (a3c4c5f3-e7a5-431b-a5dc-000939a21c67): created successfully
Sep 10 19:22:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4507b893-e57a-4586-ac6f-019b75837931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:22:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Flow 'volume_create_manager' (727a2bba-ce36-4db0-bf74-8e0663a05eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:22:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-6d8c8691-9d3e-48ad-8170-e1ffb7e89cc6 tempest-GroupsTest-1091361080 None] Created volume successfully.
Sep 10 19:23:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b9187ff1-6a46-46f5-961f-a54ca2a2c529 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b9187ff1-6a46-46f5-961f-a54ca2a2c529 tempest-GroupsTest-1091361080 None] Update group completed successfully.
Sep 10 19:23:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d977666d-c788-41a6-a668-2a98f44073ca tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d977666d-c788-41a6-a668-2a98f44073ca tempest-GroupsTest-1091361080 None] Update group completed successfully.
Sep 10 19:23:03 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Acquiring lock "cinder-quobyte-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:03 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de9c8d-9bd4-4c98-97b0-98ca051aff01]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" returned: 0 in 0.611s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" returned: 0 in 0.122s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-93dde4cb-619f-40ae-a2e5-f7b90a60fde7" released by "delete_volume" :: held 0.911s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Acquiring lock "cinder-quobyte-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3fc20f-17f9-402f-9f4d-8fe85018b063]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" returned: 0 in 0.536s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" returned: 0 in 0.182s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "cinder-quobyte-a3c4c5f3-e7a5-431b-a5dc-000939a21c67" released by "delete_volume" :: held 0.867s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Created reservations ['7869adf0-a008-43d5-8b5e-ee35e521f7a5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:06 devstack cinder-volume[82863]: WARNING cinder.quota [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1145087339 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1145087339, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:23:06 devstack cinder-volume[82863]: WARNING cinder.quota [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1145087339 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1145087339, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Created reservations ['724b915f-8e45-455d-9e2e-b69d77db62ba', 'f38a0d3e-3705-46c5-ad5d-fb9f75a4e1e0', '7ba99232-5390-48b6-bc16-097cf7949bcc', 'b8e5e42a-d106-4b10-a91a-cfa3091c4116'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Created reservations ['56c7427d-4a27-4e5a-a2c1-20e63811443d', '22aebd5e-db11-46d7-ad64-74ef8603a488', '0a11d0ca-234f-41d6-b6d1-8884fe239540', '2a8cac90-3bf7-4921-955f-75097c0b9427'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:23:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-10674eac-393b-4fb3-a1a9-bdf472ac45b9 tempest-GroupsTest-1091361080 None] Delete group completed successfully.
Sep 10 19:23:16 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Flow 'volume_create_manager' (28f5d86f-eebb-4846-b941-2a07c61c48b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8bb75d-b2f8-48dd-97b6-8fc6940b8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8bb75d-b2f8-48dd-97b6-8fc6940b8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1723449483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d510507-e53c-4d6b-ae12-517c975d5d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8618865da2e14b3a9fe2dfac4b4c16c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:16Z,use_quota=True,user_id='ee786fe8536042dc827f34817851d55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e01e7be-6714-46a3-9b96-122bf5fffd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e01e7be-6714-46a3-9b96-122bf5fffd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a3bb63-84f2-4e38-825b-b6e171975d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a3bb63-84f2-4e38-825b-b6e171975d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d510507-e53c-4d6b-ae12-517c975d5d08', 'volume_name': 'volume-4d510507-e53c-4d6b-ae12-517c975d5d08', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96ca217-a8e4-464d-b3e6-36dd9569cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e96ca217-a8e4-464d-b3e6-36dd9569cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1856a6-7e7e-426b-b27c-2178b5137b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:16 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Volume 4d510507-e53c-4d6b-ae12-517c975d5d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d510507-e53c-4d6b-ae12-517c975d5d08', 'volume_size': 1}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1723449483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d510507-e53c-4d6b-ae12-517c975d5d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8618865da2e14b3a9fe2dfac4b4c16c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:16Z,use_quota=True,user_id='ee786fe8536042dc827f34817851d55d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Creating volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:23:16 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:23:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:16 devstack quobyte-client[82905]: System call of process 92083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:16 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=46, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 1073741824" returned: 0 in 0.667s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08" returned: 0 in 0.181s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1856a6-7e7e-426b-b27c-2178b5137b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d510507-e53c-4d6b-ae12-517c975d5d08', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fb0421-8567-4a23-a533-988c23c9567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:18 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Volume volume-4d510507-e53c-4d6b-ae12-517c975d5d08 (4d510507-e53c-4d6b-ae12-517c975d5d08): created successfully
Sep 10 19:23:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fb0421-8567-4a23-a533-988c23c9567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Flow 'volume_create_manager' (28f5d86f-eebb-4846-b941-2a07c61c48b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-78b9d687-12d2-41b1-9112-64dcdd0d1f9a tempest-SnapshotsActionsTest-1761858308 None] Created volume successfully.
Sep 10 19:23:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Creating offline snapshot c2089d4f-6ebd-4b04-b489-ed65b2e3f03a of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc73880-a58e-4dc6-8284-556c9c9ba94f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:19 devstack quobyte-client[82905]: System call of process 92089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08" returned: 0 in 0.584s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:20 devstack quobyte-client[82905]: System call of process 92093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=47, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a 1G" returned: 0 in 0.584s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.294s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.134s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.184s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.info" returned: 0 in 0.140s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.info" returned: 0 in 0.173s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.614s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:21 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=42,cinder:UPDATE=57,cinder:DELETE=4,cinder:INSERT=8 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:22 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=43,cinder:UPDATE=34,cinder:INSERT=7 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:23:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-34a5d151-2ef6-4da4-983c-a8c7ea30013f tempest-SnapshotsActionsTest-1761858308 None] Create snapshot completed successfully
Sep 10 19:23:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Creating offline snapshot 2eb27b2d-be19-4665-a17a-33ffd2aead6e of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:23:24 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a6312-4ef2-481d-bacb-4af59e33df4f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.584s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:25 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=49, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e 1G" returned: 0 in 0.447s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:25 devstack quobyte-client[82905]: System call of process 92123 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.214s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.113s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:23:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.841s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-43e2275c-eb99-46d6-871c-8eb953973203 tempest-SnapshotsActionsTest-1761858308 None] Create snapshot completed successfully
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-2eb27b2d-be19-4665-a17a-33ffd2aead6e-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-2eb27b2d-be19-4665-a17a-33ffd2aead6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-2eb27b2d-be19-4665-a17a-33ffd2aead6e" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-2eb27b2d-be19-4665-a17a-33ffd2aead6e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Deleting offline snapshot 2eb27b2d-be19-4665-a17a-33ffd2aead6e of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] snapshot_file for this snap is: volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119299c-b5e4-4b11-9d8a-b74e57c4167f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.627s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0cda1a-4c62-4b6e-8d85-7252cc71af7c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.614s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.380s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.2eb27b2d-be19-4665-a17a-33ffd2aead6e" returned: 0 in 0.137s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:29 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-2eb27b2d-be19-4665-a17a-33ffd2aead6e" released by "_delete_snapshot" :: held 2.119s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_snapshot" :: held 2.149s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:30 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Created reservations ['d758b006-f19a-4a4f-9ac5-d69334663b7d', '1259d245-1ba4-4e6a-803b-17549f60bd25', '4c7a682b-8e83-42af-9fd2-766a05b0e80c', '2a9b77b8-d14d-4f15-af2b-34e56fa477d9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Delete snapshot completed successfully.
Sep 10 19:23:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-022d1f24-a0d5-454a-9beb-e821200c5e68 tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-2eb27b2d-be19-4665-a17a-33ffd2aead6e-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Creating offline snapshot c72bfa2c-f9ac-49db-9a80-a19567686f90 of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:23:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e982314-e1b9-4b24-a5fa-2cdc4c7311bf]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.508s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:32 devstack quobyte-client[82905]: System call of process 92145 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:32 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=50, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 1G" returned: 0 in 0.376s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 0.215s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 0.108s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 0.116s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.647s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0e02fe05-7332-4731-9900-0219ba2135d3 tempest-SnapshotsActionsTest-1761858308 None] Create snapshot completed successfully
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-c72bfa2c-f9ac-49db-9a80-a19567686f90-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-c72bfa2c-f9ac-49db-9a80-a19567686f90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-c72bfa2c-f9ac-49db-9a80-a19567686f90" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-c72bfa2c-f9ac-49db-9a80-a19567686f90" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Deleting offline snapshot c72bfa2c-f9ac-49db-9a80-a19567686f90 of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] snapshot_file for this snap is: volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece66d2a-cb81-4028-ad1b-67c81f5bf1b8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:36 devstack quobyte-client[82905]: System call of process 92155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 1.130s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:36 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f5317a-a110-4149-a49c-340136f42dbf]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:36 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Flow 'volume_create_manager' (db0a3486-995e-4197-8ebc-368e216283fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a2c70b-160f-42d4-a958-e6e70ca0db22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a2c70b-160f-42d4-a958-e6e70ca0db22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1912071504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fb8094-a35e-4d82-9e05-8bc5800dafab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7164bba88593452c9626497b29ee6b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:36Z,use_quota=True,user_id='2f24193bfa7b4355af0b4ef481f3b28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31ba11-c502-4942-acb6-ff2fd8ca0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d31ba11-c502-4942-acb6-ff2fd8ca0248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a5c894-d300-4ba5-b9c2-eef58c41c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a5c894-d300-4ba5-b9c2-eef58c41c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18fb8094-a35e-4d82-9e05-8bc5800dafab', 'volume_name': 'volume-18fb8094-a35e-4d82-9e05-8bc5800dafab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3cf69b-59e9-428e-8bf4-2a5d62f93ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3cf69b-59e9-428e-8bf4-2a5d62f93ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01762f8f-2670-44d2-b390-6d3e318d4cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Volume 18fb8094-a35e-4d82-9e05-8bc5800dafab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18fb8094-a35e-4d82-9e05-8bc5800dafab', 'volume_size': 1}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1912071504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fb8094-a35e-4d82-9e05-8bc5800dafab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7164bba88593452c9626497b29ee6b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:23:36Z,use_quota=True,user_id='2f24193bfa7b4355af0b4ef481f3b28b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Creating volume 18fb8094-a35e-4d82-9e05-8bc5800dafab {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:23:37 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 1.437s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=51, name=volume-18fb8094-a35e-4d82-9e05-8bc5800dafab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.155s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab 1073741824" returned: 0 in 0.926s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 0.841s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab" returned: 0 in 0.250s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] <== create_volume: return (1293ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c72bfa2c-f9ac-49db-9a80-a19567686f90" returned: 0 in 0.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01762f8f-2670-44d2-b390-6d3e318d4cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fb8094-a35e-4d82-9e05-8bc5800dafab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4cd53-e823-49e6-bb3d-50890e66672b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-c72bfa2c-f9ac-49db-9a80-a19567686f90" released by "_delete_snapshot" :: held 4.294s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_snapshot" :: held 4.364s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:39 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Volume volume-18fb8094-a35e-4d82-9e05-8bc5800dafab (18fb8094-a35e-4d82-9e05-8bc5800dafab): created successfully
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4cd53-e823-49e6-bb3d-50890e66672b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Flow 'volume_create_manager' (db0a3486-995e-4197-8ebc-368e216283fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:23:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d3b3b5f3-c01d-4c39-ad36-afbc7cf8df8f tempest-AttachVolumeShelveTestJSON-683474098 None] Created volume successfully.
Sep 10 19:23:39 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Created reservations ['3ed80e21-bb9f-4fce-8f6f-2a549721d462', '8193cfb5-ed09-4fc1-b030-b78d60253fbc', 'e39688d5-9655-4e1e-b363-dd7c4079b4b6', '769d92b0-d931-4708-9ef2-2ff4a4b92f0d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Delete snapshot completed successfully.
Sep 10 19:23:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-21047c61-e7f7-4aaf-9dc4-5ed1466a048c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-c72bfa2c-f9ac-49db-9a80-a19567686f90-delete_snapshot" released by "delete_snapshot" :: held 4.918s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Creating offline snapshot e3034cc0-e66e-46a8-959a-0106c015a7fb of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a0ab42-47dc-49ba-8898-1ab267bd6848]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.503s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:42 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=52, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb 1G" returned: 0 in 0.308s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:42 devstack quobyte-client[82905]: System call of process 92184 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.272s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:23:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.208s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9d6cd4ec-826b-4d1d-ae9c-a86e323a8b2e tempest-SnapshotsActionsTest-1761858308 None] Create snapshot completed successfully
Sep 10 19:23:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-e3034cc0-e66e-46a8-959a-0106c015a7fb-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-e3034cc0-e66e-46a8-959a-0106c015a7fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-e3034cc0-e66e-46a8-959a-0106c015a7fb" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-e3034cc0-e66e-46a8-959a-0106c015a7fb" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Deleting offline snapshot e3034cc0-e66e-46a8-959a-0106c015a7fb of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] snapshot_file for this snap is: volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f85315b-dc6e-4a18-89c2-5daf60aab93c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.454s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[152cde68-2288-4683-b104-71a56078ecb5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:46 devstack quobyte-client[82905]: System call of process 92198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 1.110s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:47 devstack quobyte-client[82905]: System call of process 92239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.681s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.e3034cc0-e66e-46a8-959a-0106c015a7fb" returned: 0 in 0.194s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-e3034cc0-e66e-46a8-959a-0106c015a7fb" released by "_delete_snapshot" :: held 3.129s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_snapshot" :: held 3.189s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:48 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Created reservations ['055d4523-7d4d-4711-8d08-951956a28269', '8e2f082b-f44b-4b49-bef3-aad3f2d60697', '0b33098c-5a7a-4a26-8b67-8b01ba3cb4b9', '1375a2cc-1cdf-4183-baa4-6dd1fd0af35d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Delete snapshot completed successfully.
Sep 10 19:23:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2f4fd62f-b45d-4481-bcfe-2af63ac7525c tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-e3034cc0-e66e-46a8-959a-0106c015a7fb-delete_snapshot" released by "delete_snapshot" :: held 4.366s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:23:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:23:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Creating offline snapshot a4bd3842-e146-4d38-a34a-db573dad6207 of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:23:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb59635-83f3-4cc7-a04f-5ad8593d7f5f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:52 devstack quobyte-client[82905]: System call of process 92258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.940s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:52 devstack quobyte-client[82905]: System call of process 92265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:52 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=53, name=volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:23:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 1G" returned: 0 in 0.483s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img rebase -u -b volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.333s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.245s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.198s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.845s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:23:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1867fe02-00e0-434c-a9b0-9fd2436f14a5 tempest-SnapshotsActionsTest-1761858308 None] Create snapshot completed successfully
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-a4bd3842-e146-4d38-a34a-db573dad6207-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-a4bd3842-e146-4d38-a34a-db573dad6207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.186s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Acquiring lock "cinder-quobyte-a4bd3842-e146-4d38-a34a-db573dad6207" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-a4bd3842-e146-4d38-a34a-db573dad6207" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Deleting offline snapshot a4bd3842-e146-4d38-a34a-db573dad6207 of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:23:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] snapshot_file for this snap is: volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:23:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e754b04-6a06-46c2-baac-69b38c9f87ed]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:56 devstack quobyte-client[82905]: System call of process 92293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.910s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:57 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2022ee-1599-4b8b-9f83-9a36ef557c2e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:23:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:57 devstack quobyte-client[82905]: System call of process 92299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:23:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.613s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:23:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.469s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:23:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.a4bd3842-e146-4d38-a34a-db573dad6207" returned: 0 in 0.247s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:23:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-a4bd3842-e146-4d38-a34a-db573dad6207" released by "_delete_snapshot" :: held 2.859s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_snapshot" :: held 2.907s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:23:59 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Created reservations ['b4e9e8ae-0cb1-4b7d-9a64-e3c5480dc2d8', 'fe3369eb-c7e2-4473-865d-8355c717bb68', '3fd35d04-f7f6-4048-b095-6776b7645ed8', 'c7624469-8f3a-4b54-bc36-856c016f7a3e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:23:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Delete snapshot completed successfully.
Sep 10 19:23:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-46d842d3-37fe-4795-8d06-ee8fcf5aac0e tempest-SnapshotsActionsTest-1052073740 None] Lock "cinder-a4bd3842-e146-4d38-a34a-db573dad6207-delete_snapshot" released by "delete_snapshot" :: held 3.886s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "cinder-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "cinder-quobyte-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Deleting offline snapshot c2089d4f-6ebd-4b04-b489-ed65b2e3f03a of volume 4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] snapshot_file for this snap is: volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8a798f-526e-4e48-b8ff-1c0301c6b3ef]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:02 devstack quobyte-client[82905]: System call of process 92313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.623s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d510507-e53c-4d6b-ae12-517c975d5d08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:24:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e02ab3-7d77-4bd5-8ab8-18b46ef0d16f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08" returned: 0 in 0.548s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.344s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08.c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a" released by "_delete_snapshot" :: held 1.990s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_snapshot" :: held 2.026s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:04 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Created reservations ['9dff9a4c-f099-46a1-b49b-f696bd22eca6', '4f54b56f-8d89-41fa-b65f-9cf196d47777', 'd8978523-84f5-49bb-bb77-f8688cc861e5', '95cc48d1-7024-4c2c-bb9e-f19bfb6948e3'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:24:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Delete snapshot completed successfully.
Sep 10 19:24:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-78f67659-ab89-4e50-a81f-283fd73e4daf tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-c2089d4f-6ebd-4b04-b489-ed65b2e3f03a-delete_snapshot" released by "delete_snapshot" :: held 3.105s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "cinder-4d510507-e53c-4d6b-ae12-517c975d5d08-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-4d510507-e53c-4d6b-ae12-517c975d5d08-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" acquired by "delete_volume" :: waited 0.031s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadfe793-bb74-48d1-a483-48b6d6a587ea]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:07 devstack quobyte-client[82905]: System call of process 92329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:24:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08" returned: 0 in 1.066s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4d510507-e53c-4d6b-ae12-517c975d5d08" returned: 0 in 0.129s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-quobyte-4d510507-e53c-4d6b-ae12-517c975d5d08" released by "delete_volume" :: held 1.476s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Created reservations ['fffe99fa-8032-4b68-852d-f0275a74e541', 'c70a33a7-c876-49c4-a698-e08fa95cdc89', 'fa47c2e9-b009-4a38-81e3-9cf95c730c14', 'd1112cdf-0d9b-462d-b94c-8c3aef91cb64'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.193s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Deleted volume successfully.
Sep 10 19:24:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-14c0a55a-2aa2-4cc4-9446-2c6fd11f326f tempest-SnapshotsActionsTest-1761858308 None] Lock "cinder-4d510507-e53c-4d6b-ae12-517c975d5d08-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-9c27d03f-bf09-4f35-ac78-2e8bfb738916 req-40ab3938-204d-46f9-831d-48b4844e93b2 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-9c27d03f-bf09-4f35-ac78-2e8bfb738916 req-40ab3938-204d-46f9-831d-48b4844e93b2 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-9c27d03f-bf09-4f35-ac78-2e8bfb738916 req-40ab3938-204d-46f9-831d-48b4844e93b2 tempest-AttachVolumeShelveTestJSON-683474098 None] No connector for attachment 90932f4f-9712-4071-b714-05d44baf2b57; skipping storage backend terminate_connection call. {{(pid=82863) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 10 19:24:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-9c27d03f-bf09-4f35-ac78-2e8bfb738916 req-40ab3938-204d-46f9-831d-48b4844e93b2 tempest-AttachVolumeShelveTestJSON-683474098 None] Deleting attachment 90932f4f-9712-4071-b714-05d44baf2b57. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:24:21 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=36,cinder:SELECT=39,cinder:DELETE=4,cinder:INSERT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:24:21 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:DELETE=3,cinder:SELECT=33,cinder:UPDATE=48,cinder:INSERT=18 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:24:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-2f0f634a-ab4e-47ed-8645-019266f716c7 req-2e844814-c2ad-413f-a72b-d11256043973 tempest-TestMinimumBasicScenario-1463242741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-2f0f634a-ab4e-47ed-8645-019266f716c7 req-2e844814-c2ad-413f-a72b-d11256043973 tempest-TestMinimumBasicScenario-1463242741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-2f0f634a-ab4e-47ed-8645-019266f716c7 req-2e844814-c2ad-413f-a72b-d11256043973 tempest-TestMinimumBasicScenario-1463242741 None] Terminate volume connection completed successfully.
Sep 10 19:24:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-2f0f634a-ab4e-47ed-8645-019266f716c7 req-2e844814-c2ad-413f-a72b-d11256043973 tempest-TestMinimumBasicScenario-1463242741 None] Deleting attachment 47c23e92-6cee-442a-a09a-1f0ec31628ec. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "cinder-90b63e50-10b6-4cef-a752-19fcb01b81de-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "cinder-90b63e50-10b6-4cef-a752-19fcb01b81de-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "cinder-quobyte-90b63e50-10b6-4cef-a752-19fcb01b81de" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "cinder-quobyte-90b63e50-10b6-4cef-a752-19fcb01b81de" acquired by "delete_volume" :: waited 0.021s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[995750ff-a2cb-48ae-ac2a-52ffe912bf14]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.185s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de" returned: 0 in 1.157s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-90b63e50-10b6-4cef-a752-19fcb01b81de" returned: 0 in 0.183s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "cinder-quobyte-90b63e50-10b6-4cef-a752-19fcb01b81de" released by "delete_volume" :: held 1.553s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Created reservations ['f8654158-b8d7-45a8-8359-406b77e04835', 'abc3ce2c-acad-4bb4-b918-55488044decc', '70aba6be-6c35-4534-b849-0fa345ed942b', '3cef0351-79ac-438e-981f-738b8c045a3b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.163s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Deleted volume successfully.
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7bef4df2-c60d-43ef-b887-1b69e99b7792 tempest-TestMinimumBasicScenario-1463242741 None] Lock "cinder-90b63e50-10b6-4cef-a752-19fcb01b81de-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Flow 'volume_create_manager' (895d1289-4655-4834-8594-ec75013b1d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:24:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8868b424-7c54-441f-a2be-ecf49550e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8868b424-7c54-441f-a2be-ecf49550e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-976627352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bdcaca-a41c-4bf4-bb47-40bb573d85d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040633b8ad994b8f9e0ee1c542eb5a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:24:40Z,use_quota=True,user_id='a4c7c5c13e69455cbaaf4ba55907b264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c594fc-4365-4678-997b-f542bd398a92),volume_type_id=34c594fc-4365-4678-997b-f542bd398a92)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c348c13-6679-4f9d-abd2-9e9e47dc27be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c348c13-6679-4f9d-abd2-9e9e47dc27be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a964d012-3955-4c44-99ed-6a12584ef39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a964d012-3955-4c44-99ed-6a12584ef39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bdcaca-a41c-4bf4-bb47-40bb573d85d0', 'volume_name': 'volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2583ad6-e649-402d-88e7-4e12951bb222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2583ad6-e649-402d-88e7-4e12951bb222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48146232-82f4-47ce-b4c5-1eff013c386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume 24bdcaca-a41c-4bf4-bb47-40bb573d85d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0', 'volume_size': 1}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-976627352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bdcaca-a41c-4bf4-bb47-40bb573d85d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='040633b8ad994b8f9e0ee1c542eb5a9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:24:40Z,use_quota=True,user_id='a4c7c5c13e69455cbaaf4ba55907b264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34c594fc-4365-4678-997b-f542bd398a92),volume_type_id=34c594fc-4365-4678-997b-f542bd398a92)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Creating volume 24bdcaca-a41c-4bf4-bb47-40bb573d85d0 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:24:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:24:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:41 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=54, name=volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:24:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 1073741824" returned: 0 in 1.139s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" returned: 0 in 0.238s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] <== create_volume: return (1522ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:24:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48146232-82f4-47ce-b4c5-1eff013c386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2693e1-25bc-4ca1-9358-b5426225e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:24:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 (24bdcaca-a41c-4bf4-bb47-40bb573d85d0): created successfully
Sep 10 19:24:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f2693e1-25bc-4ca1-9358-b5426225e966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:24:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Flow 'volume_create_manager' (895d1289-4655-4834-8594-ec75013b1d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:24:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9b3ab182-84ce-4ee6-95d0-8268a7e7c73e tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Created volume successfully.
Sep 10 19:24:44 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:45 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0665c17e-da5c-46b8-8da3-839d4af29753 tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Retype volume completed successfully.
Sep 10 19:24:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "cinder-24bdcaca-a41c-4bf4-bb47-40bb573d85d0-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "cinder-24bdcaca-a41c-4bf4-bb47-40bb573d85d0-delete_volume" acquired by "delete_volume" :: waited 0.412s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:48 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:24:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "cinder-quobyte-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:24:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "cinder-quobyte-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" acquired by "delete_volume" :: waited 0.113s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:24:48 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f32c72-a812-4672-8c00-c65d09710858]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:24:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" returned: 0 in 1.538s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" returned: 0 in 0.499s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "cinder-quobyte-24bdcaca-a41c-4bf4-bb47-40bb573d85d0" released by "delete_volume" :: held 2.805s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:24:51 devstack cinder-volume[82863]: WARNING cinder.quota [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:24:51 devstack cinder-volume[82863]: WARNING cinder.quota [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Created reservations ['f8e0dca8-8894-4011-b7ca-c9d38fe639a9', '11b6b349-9107-4d93-b731-ef54108e7864', '276e8ac8-54a0-4261-b77b-862bd13508df', '4f2f978e-2bf1-4226-9190-53d9f9dcf589'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.273s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:24:52 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:24:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Deleted volume successfully.
Sep 10 19:24:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-83aab42d-7e74-4159-af66-99058bd7168c tempest-VolumeRetypeWithoutMigrationTest-53061549 None] Lock "cinder-24bdcaca-a41c-4bf4-bb47-40bb573d85d0-delete_volume" released by "delete_volume" :: held 6.420s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:25:02 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:03 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=21,cinder:INSERT=2,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Flow 'volume_create_manager' (52ab2971-99d5-45a9-82e3-9c6a961383e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1d372-baf2-4bab-993e-cbd7088cd9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57c1d372-baf2-4bab-993e-cbd7088cd9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2000621382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e96787-a09c-4576-a79a-4bb06b5e8c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c7cbb566994882837697b65597f06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:25:06Z,use_quota=True,user_id='0c32a15d3157498b8a3fd101623c499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ced820-29ca-4fa8-ac51-7e6e442084e7),volume_type_id=a1ced820-29ca-4fa8-ac51-7e6e442084e7)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc6d437-aabd-4877-b9ed-8695336449d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc6d437-aabd-4877-b9ed-8695336449d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0885ad65-7ee5-4608-bc92-2ce84825c211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0885ad65-7ee5-4608-bc92-2ce84825c211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e96787-a09c-4576-a79a-4bb06b5e8c33', 'volume_name': 'volume-15e96787-a09c-4576-a79a-4bb06b5e8c33', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216eb9b-648d-46a8-a755-4546437f819a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216eb9b-648d-46a8-a755-4546437f819a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59d491-4749-4376-9c99-aec3e5f894c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:06 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Volume 15e96787-a09c-4576-a79a-4bb06b5e8c33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e96787-a09c-4576-a79a-4bb06b5e8c33', 'volume_size': 1}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2000621382',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e96787-a09c-4576-a79a-4bb06b5e8c33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c7cbb566994882837697b65597f06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:25:06Z,use_quota=True,user_id='0c32a15d3157498b8a3fd101623c499d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ced820-29ca-4fa8-ac51-7e6e442084e7),volume_type_id=a1ced820-29ca-4fa8-ac51-7e6e442084e7)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Creating volume 15e96787-a09c-4576-a79a-4bb06b5e8c33 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:25:06 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:25:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:07 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=55, name=volume-15e96787-a09c-4576-a79a-4bb06b5e8c33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:25:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 1073741824" returned: 0 in 0.521s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33" returned: 0 in 0.162s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:25:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd59d491-4749-4376-9c99-aec3e5f894c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e96787-a09c-4576-a79a-4bb06b5e8c33', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94088e1-ed90-4134-b5fa-804ebe45464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:08 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Volume volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 (15e96787-a09c-4576-a79a-4bb06b5e8c33): created successfully
Sep 10 19:25:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94088e1-ed90-4134-b5fa-804ebe45464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Flow 'volume_create_manager' (52ab2971-99d5-45a9-82e3-9c6a961383e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:25:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4e0eb068-9fe5-4ace-939d-b3a5283ff117 tempest-VolumeTypesAccessTest-1476041604 None] Created volume successfully.
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Acquiring lock "cinder-15e96787-a09c-4576-a79a-4bb06b5e8c33-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "cinder-15e96787-a09c-4576-a79a-4bb06b5e8c33-delete_volume" acquired by "delete_volume" :: waited 0.242s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:25:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Acquiring lock "cinder-quobyte-15e96787-a09c-4576-a79a-4bb06b5e8c33" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "cinder-quobyte-15e96787-a09c-4576-a79a-4bb06b5e8c33" acquired by "delete_volume" :: waited 0.039s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4de4d7-cceb-40e8-8d68-819ade8d53c0]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:25:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33" returned: 0 in 0.814s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-15e96787-a09c-4576-a79a-4bb06b5e8c33" returned: 0 in 0.377s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "cinder-quobyte-15e96787-a09c-4576-a79a-4bb06b5e8c33" released by "delete_volume" :: held 2.074s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:25:12 devstack cinder-volume[82863]: WARNING cinder.quota [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1819605219 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1819605219, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:25:12 devstack cinder-volume[82863]: WARNING cinder.quota [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1819605219 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1819605219, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Created reservations ['51f4ce69-d5fc-4d43-95bd-7d10140d5d28', '0325e293-b977-49de-8847-feb1d37e2395', '2a0b865f-45d1-489e-898e-078c820c7c81', 'c58bca8d-6fc5-49fb-9269-8a5a0be562ad'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.453s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:14 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:25:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Deleted volume successfully.
Sep 10 19:25:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f2626d62-14a7-4ad1-b6df-aa4135e88085 tempest-VolumeTypesAccessTest-1476041604 None] Lock "cinder-15e96787-a09c-4576-a79a-4bb06b5e8c33-delete_volume" released by "delete_volume" :: held 5.256s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:25:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:24 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=9,cinder:DELETE=2,cinder:SELECT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.129s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:25:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (856ce463-03d0-4bdf-8570-7fd2c10cc32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cc38b5-265b-4409-a91c-3a859e45cc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2cc38b5-265b-4409-a91c-3a859e45cc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1093828279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d21aed5-fb95-4e3b-a9e7-c9f009add8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6a39288042a9aafa70a31a142811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:25:58Z,use_quota=True,user_id='f2cc65c9deb948a6a50ee8333c9093c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708621d7-39ea-4814-ad59-fa3fe5e97f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708621d7-39ea-4814-ad59-fa3fe5e97f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30b95f-0d5a-4eb2-aeb5-65ff904020b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb30b95f-0d5a-4eb2-aeb5-65ff904020b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d21aed5-fb95-4e3b-a9e7-c9f009add8be', 'volume_name': 'volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845da6a3-3178-4eda-9986-86595d4ba1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845da6a3-3178-4eda-9986-86595d4ba1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd06fd-ed09-4583-9649-69e73db6b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:58 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be', 'volume_size': 1}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1093828279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d21aed5-fb95-4e3b-a9e7-c9f009add8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6a39288042a9aafa70a31a142811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:25:58Z,use_quota=True,user_id='f2cc65c9deb948a6a50ee8333c9093c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Creating volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:25:58 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:58 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=56, name=volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be 1073741824" returned: 0 in 0.513s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 0.142s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20bd06fd-ed09-4583-9649-69e73db6b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6eaa57-c2f5-41b0-ba4f-de9eda727466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:25:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Volume volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be (7d21aed5-fb95-4e3b-a9e7-c9f009add8be): created successfully
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6eaa57-c2f5-41b0-ba4f-de9eda727466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:25:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (856ce463-03d0-4bdf-8570-7fd2c10cc32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:25:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8e46494d-e106-4d27-be3e-e0334f687aac tempest-VolumesDeleteCascade-617567028 None] Created volume successfully.
Sep 10 19:26:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Creating offline snapshot 1895f260-e717-4e73-a7f6-397f9feb6bb9 of volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:26:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[59898687-4d27-4616-898d-52552612bacf]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 0.677s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:01 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=57, name=volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 1G" returned: 0 in 0.399s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.258s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.137s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.229s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.info" returned: 0 in 0.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.info" returned: 0 in 0.243s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-79949d3d-d785-4578-a9d1-ae5d96849ee7 tempest-VolumesDeleteCascade-617567028 None] Create snapshot completed successfully
Sep 10 19:26:05 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Creating offline snapshot f3444c13-aa3a-411c-a8c6-04de1050eef1 of volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:26:05 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2718efc2-6841-45e4-826a-20454ca1093d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 1.006s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:06 devstack quobyte-client[82905]: System call of process 92968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:06 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=59, name=volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 1G" returned: 0 in 0.564s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:07 devstack quobyte-client[82905]: System call of process 92971 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.207s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.142s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.167s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8788a566-9da7-48ff-970b-1638b67b54b6 tempest-VolumesDeleteCascade-617567028 None] Create snapshot completed successfully
Sep 10 19:26:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Flow 'volume_create_manager' (9dd406e4-9c88-427f-af77-fba91113537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f3e32e-d17f-403c-ac30-e95ec0bbf7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64f3e32e-d17f-403c-ac30-e95ec0bbf7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-687601631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7c2b9f-c1b1-4762-958e-86d55612f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8728412db52447b99bace7378b0bb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:08Z,use_quota=True,user_id='613a65d014424baf8c2eaa06f1cb318e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0db096b-b81a-4abc-bf10-abf6fd1be2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0db096b-b81a-4abc-bf10-abf6fd1be2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037ddcbc-be3f-4e9e-bde6-0138c11f891c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037ddcbc-be3f-4e9e-bde6-0138c11f891c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7c2b9f-c1b1-4762-958e-86d55612f2f7', 'volume_name': 'volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b04b198-0280-43c4-bbfa-aec96742bfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b04b198-0280-43c4-bbfa-aec96742bfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e6ee6-4a9d-47d4-bb11-8a72e33cca61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:08 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Volume bc7c2b9f-c1b1-4762-958e-86d55612f2f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7', 'volume_size': 1}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-687601631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7c2b9f-c1b1-4762-958e-86d55612f2f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8728412db52447b99bace7378b0bb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:08Z,use_quota=True,user_id='613a65d014424baf8c2eaa06f1cb318e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Creating volume bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:08 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:08 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=60, name=volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 1073741824" returned: 0 in 0.396s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] <== create_volume: return (583ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946e6ee6-4a9d-47d4-bb11-8a72e33cca61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02c2744-5ed6-4bfd-b944-37ef497c1ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:09 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Volume volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 (bc7c2b9f-c1b1-4762-958e-86d55612f2f7): created successfully
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c02c2744-5ed6-4bfd-b944-37ef497c1ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Flow 'volume_create_manager' (9dd406e4-9c88-427f-af77-fba91113537f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-7d21aed5-fb95-4e3b-a9e7-c9f009add8be-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-22c489cb-f926-467f-a835-9d29efbedb06 tempest-SnapshotDependencyTests-663368099 None] Created volume successfully.
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-7d21aed5-fb95-4e3b-a9e7-c9f009add8be-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Performing cascade delete. {{(pid=82863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-1895f260-e717-4e73-a7f6-397f9feb6bb9-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-1895f260-e717-4e73-a7f6-397f9feb6bb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-1895f260-e717-4e73-a7f6-397f9feb6bb9" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-1895f260-e717-4e73-a7f6-397f9feb6bb9" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Deleting offline snapshot 1895f260-e717-4e73-a7f6-397f9feb6bb9 of volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] snapshot_file for this snap is: volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700107b-45cd-41d9-9097-299ae7bfc7c5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.438s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:10 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9702057f-8e55-4995-b39b-f11fe1d705a6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 0.730s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Creating offline snapshot 5471831f-e5dd-4d70-bf60-fe3b72bd090f of volume bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[49222cf1-9932-45c5-821b-5c13a1edac8d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba71a93-0406-4bc1-9ccf-74df4f54d447]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:11 devstack quobyte-client[82905]: System call of process 92988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.740s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1c1d6d-ee40-4bf1-a7c1-1b4dbc5877d7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.778s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:12 devstack quobyte-client[82905]: System call of process 92996 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:12 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=61, name=volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f 1G" returned: 0 in 0.352s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.695s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8657fbf6-d346-4b36-8a81-d81454427781]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "qemu-img rebase -u -b volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.318s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.163s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.280s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 0.829s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.info" returned: 0 in 0.336s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.info" returned: 0 in 0.148s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.164s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.694s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-58b686db-cce1-459b-82d8-b59534a31992 tempest-SnapshotDependencyTests-663368099 None] Create snapshot completed successfully
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.1895f260-e717-4e73-a7f6-397f9feb6bb9" returned: 0 in 0.280s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 -F qcow2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:15 devstack quobyte-client[82905]: System call of process 93015 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img rebase -u -b volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 -F qcow2" returned: 0 in 0.307s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "cinder-18fb8094-a35e-4d82-9e05-8bc5800dafab-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-1895f260-e717-4e73-a7f6-397f9feb6bb9" released by "_delete_snapshot" :: held 5.537s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" released by "delete_snapshot" :: held 5.568s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-18fb8094-a35e-4d82-9e05-8bc5800dafab-delete_volume" acquired by "delete_volume" :: waited 0.182s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "cinder-quobyte-18fb8094-a35e-4d82-9e05-8bc5800dafab" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-quobyte-18fb8094-a35e-4d82-9e05-8bc5800dafab" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Created reservations ['91f719a2-78f8-4aeb-921a-307d84ff6978', '80a34720-d7bb-4696-8180-138f64ff6d55', 'db7be292-e871-4676-bc4b-77ebb184d424', 'e888c686-6dc0-4b39-873b-5fba228114c0'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[758fae16-0376-47b4-9c27-7d7472cb4bff]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:16 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:16 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Delete snapshot completed successfully.
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-1895f260-e717-4e73-a7f6-397f9feb6bb9-delete_snapshot" released by "delete_snapshot" :: held 6.881s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-f3444c13-aa3a-411c-a8c6-04de1050eef1-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab" returned: 0 in 0.880s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Flow 'volume_create_manager' (b40abcd7-008a-4ca8-bff0-97a40110094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724eff40-d17b-4af4-95d7-39b3c6e9aacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724eff40-d17b-4af4-95d7-39b3c6e9aacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539bd408-199b-4b54-ab4e-a2c014c17f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8728412db52447b99bace7378b0bb707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5471831f-e5dd-4d70-bf60-fe3b72bd090f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:16Z,use_quota=True,user_id='613a65d014424baf8c2eaa06f1cb318e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff8b98-eb6c-474b-9bac-9381e361cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ff8b98-eb6c-474b-9bac-9381e361cb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77819722-c724-4c1a-8a5a-4d3b0ba78bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77819722-c724-4c1a-8a5a-4d3b0ba78bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '539bd408-199b-4b54-ab4e-a2c014c17f98', 'volume_name': 'volume-539bd408-199b-4b54-ab4e-a2c014c17f98', 'volume_size': 1, 'snapshot_id': '5471831f-e5dd-4d70-bf60-fe3b72bd090f'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d11357-87cd-414a-a464-5a31e7242764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d11357-87cd-414a-a464-5a31e7242764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516b1c5b-9b21-475e-8566-bce9cf6b8073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Volume 539bd408-199b-4b54-ab4e-a2c014c17f98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-539bd408-199b-4b54-ab4e-a2c014c17f98', 'volume_size': 1, 'snapshot_id': '5471831f-e5dd-4d70-bf60-fe3b72bd090f'}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-f3444c13-aa3a-411c-a8c6-04de1050eef1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.539s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:17 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-18fb8094-a35e-4d82-9e05-8bc5800dafab" returned: 0 in 0.475s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f-539bd408-199b-4b54-ab4e-a2c014c17f98" by "_create_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-quobyte-18fb8094-a35e-4d82-9e05-8bc5800dafab" released by "delete_volume" :: held 1.545s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f-539bd408-199b-4b54-ab4e-a2c014c17f98" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Creating volume 539bd408-199b-4b54-ab4e-a2c014c17f98 from snapshot 5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" by "_copy_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" acquired by "delete_snapshot" :: waited 0.076s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-f3444c13-aa3a-411c-a8c6-04de1050eef1" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" acquired by "_copy_volume_from_snapshot" :: waited 0.115s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] snapshot: 5471831f-e5dd-4d70-bf60-fe3b72bd090f, volume: 539bd408-199b-4b54-ab4e-a2c014c17f98,  {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-f3444c13-aa3a-411c-a8c6-04de1050eef1" acquired by "_delete_snapshot" :: waited 0.151s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Deleting offline snapshot f3444c13-aa3a-411c-a8c6-04de1050eef1 of volume 7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] snapshot_file for this snap is: volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Created reservations ['bc1d73aa-c930-4c8a-a10b-4373021f0a2c', '6eab3a33-4417-4592-a28e-5eb2c64ae181', 'ba362faf-dbce-417e-a7db-c19bb9d3e9c9', 'e15a45ed-ec17-4dd7-8a8b-a1446bdf5b80'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df2fe9-8a09-410f-ab77-06d4f0fa67e5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c7bb0d-ad2c-4bef-b09c-04cfb95565f7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:18 devstack quobyte-client[82905]: System call of process 93022 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.679s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad091c67-e0a6-4bf3-9b9b-291ca0a24b46]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:18 devstack quobyte-client[82905]: System call of process 93023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.453s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:18 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Deleted volume successfully.
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 1.184s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "cinder-466c3395-cba3-4399-82c6-4b6a3b46e538-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Creating direct copy from snapshot {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a642c75c-8c73-4796-8475-03445a246e68]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 1.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-70f9733d-f3f5-4784-8e92-68824aaa82af tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-18fb8094-a35e-4d82-9e05-8bc5800dafab-delete_volume" released by "delete_volume" :: held 4.200s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-466c3395-cba3-4399-82c6-4b6a3b46e538-delete_volume" acquired by "delete_volume" :: waited 1.098s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 1.314s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG cinder.utils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 not found in is_blk_device check {{(pid=82863) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.861s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:20 devstack quobyte-client[82905]: System call of process 93071 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=63, name=volume-539bd408-199b-4b54-ab4e-a2c014c17f98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be.f3444c13-aa3a-411c-a8c6-04de1050eef1" returned: 0 in 0.442s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:21 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "cinder-quobyte-466c3395-cba3-4399-82c6-4b6a3b46e538" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-f3444c13-aa3a-411c-a8c6-04de1050eef1" released by "_delete_snapshot" :: held 4.042s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" released by "delete_snapshot" :: held 4.240s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-quobyte-466c3395-cba3-4399-82c6-4b6a3b46e538" acquired by "delete_volume" :: waited 0.173s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23913e56-44dd-459b-b0e9-1e5fbfacbbde]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:23 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Created reservations ['c11692d1-eb21-4956-9999-75eec734d3c4', '41f691d4-3082-4656-b7e0-5002dd729cf7', '5c5645b9-ffa1-4e39-bb22-f778ec2bded1', '5e48c184-e5ac-47d9-9a94-19f49f2991a2'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:23 devstack quobyte-client[82905]: System call of process 93094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538" returned: 0 in 1.990s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-466c3395-cba3-4399-82c6-4b6a3b46e538" returned: 0 in 0.393s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:25 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Delete snapshot completed successfully.
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-quobyte-466c3395-cba3-4399-82c6-4b6a3b46e538" released by "delete_volume" :: held 3.348s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-f3444c13-aa3a-411c-a8c6-04de1050eef1-delete_snapshot" released by "delete_snapshot" :: held 8.177s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Snapshots deleted, issuing volume delete {{(pid=82863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" acquired by "delete_volume" :: waited 0.207s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:25 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Created reservations ['09e2f729-b8af-45ed-b68c-1d44d62a9ab6', '8ecc7ef4-a5b4-44b0-a75b-f5d681d9fae0', 'f7a20185-7701-4cb2-8ae5-fdcd6486df15', '23c6e67a-cf9b-4bbc-a7c6-c6a97619daa3'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ba7041-3bcd-4740-ad0a-cd4aa42f7a7a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.048s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.111s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:28 devstack quobyte-client[82905]: System call of process 93103 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 2.092s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.822s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:29 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Deleted volume successfully.
Sep 10 19:26:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" returned: 0 in 1.364s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f77a6f2c-7e87-4d76-ac3e-46430eae68a7 tempest-AttachVolumeShelveTestJSON-683474098 None] Lock "cinder-466c3395-cba3-4399-82c6-4b6a3b46e538-delete_volume" released by "delete_volume" :: held 9.732s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-7d21aed5-fb95-4e3b-a9e7-c9f009add8be" released by "delete_volume" :: held 4.546s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98" returned: 0 in 9.670s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea88f85e-20d6-445c-a08d-621d410f5883]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:30 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Created reservations ['723d260c-80b9-4d37-a248-c7aa5a7253b4', '8b717393-54e8-400f-a000-9bd31fa7cacb', '66b05880-6f44-4e7c-b0c4-dbf0d33d1603', '8a75d89f-b4a1-408a-bd82-7012f9d2cc1b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.886s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7, size 1024.00 MB, duration 9.67 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:26:31 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Converted 1024.00 MB image at 105.86 MB/s
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.326s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98" returned: 0 in 0.321s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Deleted volume successfully.
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" released by "_copy_volume_from_snapshot" :: held 14.411s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f-539bd408-199b-4b54-ab4e-a2c014c17f98" released by "_create_volume_from_snapshot" :: held 14.585s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.671s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a027a1a0-57fa-430e-95be-e821dddd8e7c tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-7d21aed5-fb95-4e3b-a9e7-c9f009add8be-delete_volume" released by "delete_volume" :: held 22.598s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516b1c5b-9b21-475e-8566-bce9cf6b8073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539bd408-199b-4b54-ab4e-a2c014c17f98', 'volume_size': 1, 'snapshot_id': '5471831f-e5dd-4d70-bf60-fe3b72bd090f'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298cbb95-7b17-4559-a0a1-6b331a6f33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Volume volume-539bd408-199b-4b54-ab4e-a2c014c17f98 (539bd408-199b-4b54-ab4e-a2c014c17f98): created successfully
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298cbb95-7b17-4559-a0a1-6b331a6f33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Flow 'volume_create_manager' (b40abcd7-008a-4ca8-bff0-97a40110094f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:32 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a438571d-e727-45c8-a930-56329e7ad527 tempest-SnapshotDependencyTests-663368099 None] Created volume successfully.
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-5471831f-e5dd-4d70-bf60-fe3b72bd090f-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:32 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (81412051-0b8c-4e0e-a115-2d4e6855c45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c93f7f-3f0c-44a5-baa4-563a28f257dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c93f7f-3f0c-44a5-baa4-563a28f257dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1817493257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515d01cf-defb-4a8c-a563-bb653652fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6a39288042a9aafa70a31a142811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:33Z,use_quota=True,user_id='f2cc65c9deb948a6a50ee8333c9093c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b682c7c2-f545-42ff-801f-f3610076029a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b682c7c2-f545-42ff-801f-f3610076029a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d286eb65-13d0-4a28-b9ac-085d1355bbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d286eb65-13d0-4a28-b9ac-085d1355bbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515d01cf-defb-4a8c-a563-bb653652fc9d', 'volume_name': 'volume-515d01cf-defb-4a8c-a563-bb653652fc9d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7bc07-88ff-444b-a9c6-f0507d4bb381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b7bc07-88ff-444b-a9c6-f0507d4bb381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf84cc7-ca51-4bf7-b507-d621b638b990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Volume 515d01cf-defb-4a8c-a563-bb653652fc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515d01cf-defb-4a8c-a563-bb653652fc9d', 'volume_size': 1}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1817493257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515d01cf-defb-4a8c-a563-bb653652fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6a39288042a9aafa70a31a142811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:33Z,use_quota=True,user_id='f2cc65c9deb948a6a50ee8333c9093c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Creating volume 515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:33 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-5471831f-e5dd-4d70-bf60-fe3b72bd090f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.257s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:33 devstack quobyte-client[82905]: System call of process 93116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:33 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=64, name=volume-515d01cf-defb-4a8c-a563-bb653652fc9d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" acquired by "delete_snapshot" :: waited 0.087s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Deleting offline snapshot 5471831f-e5dd-4d70-bf60-fe3b72bd090f of volume bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] snapshot_file for this snap is: volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191b659-f81a-4b3b-8a74-0557d7e67d29]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d 1073741824" returned: 0 in 0.585s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.162s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:26:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf84cc7-ca51-4bf7-b507-d621b638b990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515d01cf-defb-4a8c-a563-bb653652fc9d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689241de-486e-4d49-990b-3bf52802a28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.770s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc15ccf0-3e5d-4a41-940b-d7e0a8efdc01]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:34 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Volume volume-515d01cf-defb-4a8c-a563-bb653652fc9d (515d01cf-defb-4a8c-a563-bb653652fc9d): created successfully
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689241de-486e-4d49-990b-3bf52802a28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (81412051-0b8c-4e0e-a115-2d4e6855c45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d92c2876-7c21-44c0-a6a1-36597c8c80a7 tempest-VolumesDeleteCascade-617567028 None] Created volume successfully.
Sep 10 19:26:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.846s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.336s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7.5471831f-e5dd-4d70-bf60-fe3b72bd090f" returned: 0 in 0.469s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-5471831f-e5dd-4d70-bf60-fe3b72bd090f" released by "_delete_snapshot" :: held 2.747s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" released by "delete_snapshot" :: held 2.811s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Creating offline snapshot 91952eca-3c47-44cd-99d4-cea7ab713d66 of volume 515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4558b6bc-e720-4049-aa8c-78336947bc96]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:36 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Created reservations ['36e573f4-eece-4f23-8989-601ad5eadc5e', '1ae9e7b7-51a8-4dc0-8d7d-c0cd4021d05b', 'da3056ca-465a-4944-8166-1903300167d8', '3abefc6d-0f81-4f91-b7e7-4745e8e73019'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:37 devstack quobyte-client[82905]: System call of process 93131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Delete snapshot completed successfully.
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.842s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ab904bd0-1cc7-4ba2-8e3a-b5c7830b1534 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-5471831f-e5dd-4d70-bf60-fe3b72bd090f-delete_snapshot" released by "delete_snapshot" :: held 3.933s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:26:37 devstack quobyte-client[82905]: System call of process 93134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:37 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=65, name=volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.065s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-bc7c2b9f-c1b1-4762-958e-86d55612f2f7-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 1G" returned: 0 in 0.696s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img rebase -u -b volume-515d01cf-defb-4a8c-a563-bb653652fc9d -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.493s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:38 devstack quobyte-client[82905]: System call of process 93138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img rebase -u -b volume-515d01cf-defb-4a8c-a563-bb653652fc9d -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.346s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-bc7c2b9f-c1b1-4762-958e-86d55612f2f7-delete_volume" acquired by "delete_volume" :: waited 0.604s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.409s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:26:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.445s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" acquired by "delete_volume" :: waited 0.218s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6ff4f-a8d8-42a3-92f7-661e09afc3c5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.info" returned: 0 in 0.335s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.info" returned: 0 in 0.157s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.555s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.777s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1eef03fd-3e75-4a77-817b-9c2e5ef2f1fe tempest-VolumesDeleteCascade-617567028 None] Create snapshot completed successfully
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" returned: 0 in 0.242s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-bc7c2b9f-c1b1-4762-958e-86d55612f2f7" released by "delete_volume" :: held 1.246s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Created reservations ['7846bc0d-0733-4746-8807-540ebe5560b6', '35e69878-00ba-4203-ad15-404adbf3930f', '7ee4c556-859e-4c18-827b-7b26d7938528', 'f095240d-95ad-46f0-ac06-8d4a5d4f1283'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.128s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Deleted volume successfully.
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a5f6173c-f850-4dfd-93d1-b1a93ce7fe83 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-bc7c2b9f-c1b1-4762-958e-86d55612f2f7-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-539bd408-199b-4b54-ab4e-a2c014c17f98-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-539bd408-199b-4b54-ab4e-a2c014c17f98-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50b00a7-af8e-418b-a59f-a545d483eaf8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:42 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:26:42 devstack quobyte-client[82905]: System call of process 93152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98" returned: 0 in 0.796s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (cde3af25-41b3-4362-bf59-3e26795338b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46791e8c-9b13-4339-88ce-cbe6b57696fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46791e8c-9b13-4339-88ce-cbe6b57696fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-318266974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f6a39288042a9aafa70a31a142811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=91952eca-3c47-44cd-99d4-cea7ab713d66,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:26:42Z,use_quota=True,user_id='f2cc65c9deb948a6a50ee8333c9093c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f038b-b309-48c7-9723-f0ec79096eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f038b-b309-48c7-9723-f0ec79096eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ed069-d9b1-46f3-b2cb-a72c1119134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d64ed069-d9b1-46f3-b2cb-a72c1119134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e', 'volume_name': 'volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e', 'volume_size': 1, 'snapshot_id': '91952eca-3c47-44cd-99d4-cea7ab713d66'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7fde66-cde4-4cd3-8685-4dfc44f9986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7fde66-cde4-4cd3-8685-4dfc44f9986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bfa90-5e9a-428a-8b8e-67f996a4c3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:43 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Volume 61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e', 'volume_size': 1, 'snapshot_id': '91952eca-3c47-44cd-99d4-cea7ab713d66'}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-539bd408-199b-4b54-ab4e-a2c014c17f98" returned: 0 in 0.564s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" by "_create_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-quobyte-539bd408-199b-4b54-ab4e-a2c014c17f98" released by "delete_volume" :: held 1.461s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Creating volume 61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e from snapshot 91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" by "_copy_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] snapshot: 91952eca-3c47-44cd-99d4-cea7ab713d66, volume: 61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e,  {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d740d74-3b44-4534-b9ad-16959c00a38d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Created reservations ['6c006390-ddd2-4e63-a8a9-d1ede4ba98af', '81f4e548-e8b1-4d51-a5f7-2ccc5c281c71', '077d788b-473f-4acb-83db-497c4f59ef63', '05cfa06e-855c-4c07-9f09-275aa9f85323'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.676s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515d01cf-defb-4a8c-a563-bb653652fc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Creating direct copy from snapshot {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa18df2-c600-4042-9d7a-e4b4da331c03]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.157s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:26:44 devstack quobyte-client[82905]: System call of process 93161 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:44 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Deleted volume successfully.
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.871s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG cinder.utils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e not found in is_blk_device check {{(pid=82863) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:26:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:45 devstack quobyte-client[82905]: System call of process 93165 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:26:45 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=67, name=volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:26:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2298d014-dc80-47b5-8240-418270655e76 tempest-SnapshotDependencyTests-663368099 None] Lock "cinder-539bd408-199b-4b54-ab4e-a2c014c17f98-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" returned: 0 in 9.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d974097c-0acf-4145-a770-b1f8f5c06791]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:54 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:DELETE=6,cinder:INSERT=13 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:54 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=74,cinder:DELETE=7,cinder:SELECT=52,cinder:INSERT=19 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 1.270s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:26:55 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Converted 1024.00 MB image at 111.98 MB/s
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" returned: 0 in 0.205s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" released by "_copy_volume_from_snapshot" :: held 12.533s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" released by "_create_volume_from_snapshot" :: held 12.600s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:26:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.649s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:26:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bfa90-5e9a-428a-8b8e-67f996a4c3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e', 'volume_size': 1, 'snapshot_id': '91952eca-3c47-44cd-99d4-cea7ab713d66'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4749e8-0480-42e1-b1f5-21cdf35a1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:26:56 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Volume volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e (61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e): created successfully
Sep 10 19:26:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4749e8-0480-42e1-b1f5-21cdf35a1698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:26:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Flow 'volume_create_manager' (cde3af25-41b3-4362-bf59-3e26795338b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:26:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4a86f134-406a-4b68-9428-9746109d9fc4 tempest-VolumesDeleteCascade-617567028 None] Created volume successfully.
Sep 10 19:26:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-515d01cf-defb-4a8c-a563-bb653652fc9d-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-515d01cf-defb-4a8c-a563-bb653652fc9d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:57 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Performing cascade delete. {{(pid=82863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-91952eca-3c47-44cd-99d4-cea7ab713d66-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-91952eca-3c47-44cd-99d4-cea7ab713d66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Deleting offline snapshot 91952eca-3c47-44cd-99d4-cea7ab713d66 of volume 515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] snapshot_file for this snap is: volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d42ac3-2a59-4276-af10-5f4d679afbb8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515d01cf-defb-4a8c-a563-bb653652fc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e63e948-a815-4b9b-a802-fb13c2918781]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:26:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:26:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.801s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:26:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.409s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d.91952eca-3c47-44cd-99d4-cea7ab713d66" returned: 0 in 0.180s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-91952eca-3c47-44cd-99d4-cea7ab713d66" released by "_delete_snapshot" :: held 2.338s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" released by "delete_snapshot" :: held 2.377s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Created reservations ['ae326a7a-3b13-4743-9e5d-d3f4635d39f8', 'c26579c1-5730-4970-99c5-8d3e70872573', 'ce4eb051-6daf-4266-bcd8-4b4dcbf57e1e', 'a6266b13-ce5a-495d-9310-ccb55b597e29'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Delete snapshot completed successfully.
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-91952eca-3c47-44cd-99d4-cea7ab713d66-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Snapshots deleted, issuing volume delete {{(pid=82863) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" acquired by "delete_volume" :: waited 0.033s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfe9581-c981-4f59-b31f-45f34ef00939]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.622s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-515d01cf-defb-4a8c-a563-bb653652fc9d" returned: 0 in 0.210s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-515d01cf-defb-4a8c-a563-bb653652fc9d" released by "delete_volume" :: held 1.166s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Created reservations ['c8e32d93-75ae-4293-b5c9-cbc8fdb728c8', '60d674e4-7e98-4a64-a710-410c61cc3432', 'baab068c-96c7-42db-a84e-c95b0578dfdb', '8414f128-0084-4b73-b60f-b017e7217787'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.219s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:03 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Deleted volume successfully.
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7dd4ae44-95e2-4bb7-befe-cc0032bc5d5d tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-515d01cf-defb-4a8c-a563-bb653652fc9d-delete_volume" released by "delete_volume" :: held 6.451s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" acquired by "delete_volume" :: waited 0.024s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297c91c-5e6b-48f2-94cd-8dea36f23b51]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:05 devstack quobyte-client[82905]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" returned: 0 in 0.768s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" returned: 0 in 0.247s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-quobyte-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e" released by "delete_volume" :: held 1.201s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Created reservations ['6465e779-b2e9-4b4d-b75a-cf2053b12fbc', 'bc34eded-c534-4f41-89b5-c093d31bfb10', '70c0c2c1-8512-4428-8100-b7ef05bc9e7d', '06174c2b-d5fe-4756-823f-ad293f3ee99b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.324s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:07 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Deleted volume successfully.
Sep 10 19:27:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-40e9d571-e292-40ab-a7b5-241dd8a98659 tempest-VolumesDeleteCascade-617567028 None] Lock "cinder-61d3c8e8-3cfe-490d-a0ad-b50c7ff63c4e-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Flow 'volume_create_manager' (79a1ad4f-7bcb-4454-b6d9-7a4fe2690c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24920174-6b7e-4bbd-8883-b5a4144758b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24920174-6b7e-4bbd-8883-b5a4144758b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1036364149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a3fdb0-f916-42e1-b5d5-a585d29c5612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679eec9f3a4346f6937b95d9d115d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:15Z,use_quota=True,user_id='5fb1a7238095458eaee2101741d3dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d2836-c106-43a8-b672-01d45db792a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059d2836-c106-43a8-b672-01d45db792a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9ee9ca-c43d-48bf-bfd3-c8f519719ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9ee9ca-c43d-48bf-bfd3-c8f519719ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a3fdb0-f916-42e1-b5d5-a585d29c5612', 'volume_name': 'volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf3b3e-b924-4c59-acb1-8a3d09e27dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7cf3b3e-b924-4c59-acb1-8a3d09e27dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61638a08-798a-432c-8764-31e669b79f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:16 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Volume d1a3fdb0-f916-42e1-b5d5-a585d29c5612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612', 'volume_size': 1}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1036364149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a3fdb0-f916-42e1-b5d5-a585d29c5612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679eec9f3a4346f6937b95d9d115d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:15Z,use_quota=True,user_id='5fb1a7238095458eaee2101741d3dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Creating volume d1a3fdb0-f916-42e1-b5d5-a585d29c5612 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:16 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:16 devstack quobyte-client[82905]: System call of process 93213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:16 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=68, name=volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:DELETE=2,cinder:INSERT=11 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 1073741824" returned: 0 in 0.751s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" returned: 0 in 0.151s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61638a08-798a-432c-8764-31e669b79f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec34d9d-8c56-4558-bd14-d41e53e50892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Volume volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 (d1a3fdb0-f916-42e1-b5d5-a585d29c5612): created successfully
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec34d9d-8c56-4558-bd14-d41e53e50892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Flow 'volume_create_manager' (79a1ad4f-7bcb-4454-b6d9-7a4fe2690c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-96711ada-eb33-4e72-8d52-5c834f4f8ddc tempest-VolumesTransfersV357Test-377922592 None] Created volume successfully.
Sep 10 19:27:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ab5c01fa-6611-4cee-9c1e-c97695786f5f tempest-VolumesTransfersV357Test-982548756 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:20 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ab5c01fa-6611-4cee-9c1e-c97695786f5f tempest-VolumesTransfersV357Test-982548756 None] Transfer volume completed successfully.
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "cinder-d1a3fdb0-f916-42e1-b5d5-a585d29c5612-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-d1a3fdb0-f916-42e1-b5d5-a585d29c5612-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "cinder-quobyte-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-quobyte-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aae3f1-efbe-47f2-96cf-8eb6b3bdd7d5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" returned: 0 in 0.551s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" returned: 0 in 0.160s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-quobyte-d1a3fdb0-f916-42e1-b5d5-a585d29c5612" released by "delete_volume" :: held 0.897s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Created reservations ['24224aae-eb57-4562-9a42-2b448652f42a', 'c4a2307e-f43f-4a6f-b942-c3e3f5373298', '8608133d-b2b3-4f3b-8729-754b626facf0', '26ba29dc-f83a-4973-8009-bf6f0a03f29d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.187s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:24 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Deleted volume successfully.
Sep 10 19:27:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d0ba0b68-7873-45ae-9b6b-015c1a4651c7 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-d1a3fdb0-f916-42e1-b5d5-a585d29c5612-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:25 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:25 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Flow 'volume_create_manager' (418bbed3-d5b9-4d30-9150-e6ef1f1f521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1156c44-40b9-4ceb-a476-49ccf93863ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1156c44-40b9-4ceb-a476-49ccf93863ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1761417204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8996660-00f4-42dc-b883-ad3a86c23c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679eec9f3a4346f6937b95d9d115d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:26Z,use_quota=True,user_id='5fb1a7238095458eaee2101741d3dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3e8394-6270-451c-bd1f-93d719490139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d3e8394-6270-451c-bd1f-93d719490139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b778421-b336-4773-8b50-5e9d69bdb656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b778421-b336-4773-8b50-5e9d69bdb656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8996660-00f4-42dc-b883-ad3a86c23c2c', 'volume_name': 'volume-d8996660-00f4-42dc-b883-ad3a86c23c2c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db714ac6-e46e-41b0-a1d7-730153ed8141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db714ac6-e46e-41b0-a1d7-730153ed8141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec265d8-b3f4-40ee-8302-b58d969d9f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:26 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Volume d8996660-00f4-42dc-b883-ad3a86c23c2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8996660-00f4-42dc-b883-ad3a86c23c2c', 'volume_size': 1}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1761417204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8996660-00f4-42dc-b883-ad3a86c23c2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='679eec9f3a4346f6937b95d9d115d714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:26Z,use_quota=True,user_id='5fb1a7238095458eaee2101741d3dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Creating volume d8996660-00f4-42dc-b883-ad3a86c23c2c {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:26 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:26 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=69, name=volume-d8996660-00f4-42dc-b883-ad3a86c23c2c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c 1073741824" returned: 0 in 0.659s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c" returned: 0 in 0.168s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] <== create_volume: return (986ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec265d8-b3f4-40ee-8302-b58d969d9f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8996660-00f4-42dc-b883-ad3a86c23c2c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c1349c-b9a8-4637-abf2-284501abbb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:27 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Volume volume-d8996660-00f4-42dc-b883-ad3a86c23c2c (d8996660-00f4-42dc-b883-ad3a86c23c2c): created successfully
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c1349c-b9a8-4637-abf2-284501abbb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Flow 'volume_create_manager' (418bbed3-d5b9-4d30-9150-e6ef1f1f521d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a8d06949-726e-42c2-80b0-f27fead964d8 tempest-VolumesTransfersV357Test-377922592 None] Created volume successfully.
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "cinder-d8996660-00f4-42dc-b883-ad3a86c23c2c-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-d8996660-00f4-42dc-b883-ad3a86c23c2c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "cinder-quobyte-d8996660-00f4-42dc-b883-ad3a86c23c2c" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-quobyte-d8996660-00f4-42dc-b883-ad3a86c23c2c" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95a2a6-4765-4875-ad0e-818514de374c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c" returned: 0 in 0.507s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d8996660-00f4-42dc-b883-ad3a86c23c2c" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-quobyte-d8996660-00f4-42dc-b883-ad3a86c23c2c" released by "delete_volume" :: held 0.769s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Created reservations ['0390565d-a4a4-4c1d-b645-79f8dbaf98e7', 'eb7db8bf-0bdc-4bad-b9c6-ce4025e19d6e', 'cfaa3bce-5643-4783-8d80-151adbe139f3', 'be99f376-d817-4c57-a13a-4e0694bd2694'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:30 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Deleted volume successfully.
Sep 10 19:27:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9ec957f6-ff22-4c5c-9957-5df908977a94 tempest-VolumesTransfersV357Test-1829972948 None] Lock "cinder-d8996660-00f4-42dc-b883-ad3a86c23c2c-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.170s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:39 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=20,cinder:DELETE=2,cinder:SELECT=13,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:27:40 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=48,cinder:SELECT=27,cinder:INSERT=5,cinder:DELETE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:27:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (0b531601-3cd1-4d2a-bb6d-b56be204b5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd512b-5177-478e-9e0e-b1f078eedd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fd512b-5177-478e-9e0e-b1f078eedd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1539882596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51afd2a-d408-424f-9948-6436c8d771fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:41Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c61e2c-b718-40bb-9427-48bde187e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c61e2c-b718-40bb-9427-48bde187e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da474016-6991-4f2c-b079-df1c2089ad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da474016-6991-4f2c-b079-df1c2089ad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51afd2a-d408-424f-9948-6436c8d771fc', 'volume_name': 'volume-b51afd2a-d408-424f-9948-6436c8d771fc', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e04aae2-f74d-4fc7-bbbf-44041dd161d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e04aae2-f74d-4fc7-bbbf-44041dd161d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8404f147-de41-4087-8434-f1aaf8ec5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Volume b51afd2a-d408-424f-9948-6436c8d771fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51afd2a-d408-424f-9948-6436c8d771fc', 'volume_size': 1}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1539882596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51afd2a-d408-424f-9948-6436c8d771fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:41Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Creating volume b51afd2a-d408-424f-9948-6436c8d771fc {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:41 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:41 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=70, name=volume-b51afd2a-d408-424f-9948-6436c8d771fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc 1073741824" returned: 0 in 0.407s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc" returned: 0 in 0.198s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] <== create_volume: return (680ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8404f147-de41-4087-8434-f1aaf8ec5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51afd2a-d408-424f-9948-6436c8d771fc', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d3598d-3af0-4c65-8d21-5793db58ccbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Volume volume-b51afd2a-d408-424f-9948-6436c8d771fc (b51afd2a-d408-424f-9948-6436c8d771fc): created successfully
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d3598d-3af0-4c65-8d21-5793db58ccbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (0b531601-3cd1-4d2a-bb6d-b56be204b5cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c8c29ae3-34ea-4d88-a248-80cfbe9a672c tempest-VolumesListTestJSON-1412368237 None] Created volume successfully.
Sep 10 19:27:44 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (e17ba866-dd82-44bb-beac-663f9112585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6276d0-834b-4656-9fcc-6d77d655093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca6276d0-834b-4656-9fcc-6d77d655093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1680629014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5167fe0f-92f4-468d-8d14-9906fc6d50f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:44Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52319fa-9716-40c0-9d9f-34f09707d475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f52319fa-9716-40c0-9d9f-34f09707d475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8d9d15-838c-4ed3-a140-9319473d382b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8d9d15-838c-4ed3-a140-9319473d382b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5167fe0f-92f4-468d-8d14-9906fc6d50f8', 'volume_name': 'volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b434af7b-01cc-463c-b56a-ff2666aeaa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b434af7b-01cc-463c-b56a-ff2666aeaa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b3315a-4e76-4411-b417-a59a4cd77803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:44 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Volume 5167fe0f-92f4-468d-8d14-9906fc6d50f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8', 'volume_size': 1}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1680629014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5167fe0f-92f4-468d-8d14-9906fc6d50f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:44Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Creating volume 5167fe0f-92f4-468d-8d14-9906fc6d50f8 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:44 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:44 devstack quobyte-client[82905]: System call of process 93371 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:27:44 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=71, name=volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 1073741824" returned: 0 in 0.441s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8" returned: 0 in 0.167s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b3315a-4e76-4411-b417-a59a4cd77803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23c66b4-1608-4ed1-b907-a33ab87cb4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:45 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Volume volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 (5167fe0f-92f4-468d-8d14-9906fc6d50f8): created successfully
Sep 10 19:27:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23c66b4-1608-4ed1-b907-a33ab87cb4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (e17ba866-dd82-44bb-beac-663f9112585b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3ebad504-a0b0-40fd-aa78-bf0879286a6a tempest-VolumesListTestJSON-1412368237 None] Created volume successfully.
Sep 10 19:27:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (89569d7d-8747-4eaa-9fc1-41883df07c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddfadba-a5c2-4001-9d1f-a5715e6df088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddfadba-a5c2-4001-9d1f-a5715e6df088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-114814225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1ff7cf-c1a8-4f81-9856-f04a095834ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:47Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89753268-d96b-4390-bd41-eb0f9b7a4202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89753268-d96b-4390-bd41-eb0f9b7a4202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46bbb3-f568-49c8-a8cd-ef6ddd44b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e46bbb3-f568-49c8-a8cd-ef6ddd44b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc1ff7cf-c1a8-4f81-9856-f04a095834ab', 'volume_name': 'volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb409be-b297-4b24-9ace-68bae1f66f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb409be-b297-4b24-9ace-68bae1f66f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b730e342-5cd9-4758-ba81-99387e035eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:47 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Volume cc1ff7cf-c1a8-4f81-9856-f04a095834ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab', 'volume_size': 1}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-114814225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc1ff7cf-c1a8-4f81-9856-f04a095834ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ffa79af2f9a9452a8729791cae6ee9e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:27:47Z,use_quota=True,user_id='c53c79b22a8d48b591f78050b9f2d8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Creating volume cc1ff7cf-c1a8-4f81-9856-f04a095834ab {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:27:47 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:47 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=72, name=volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab 1073741824" returned: 0 in 0.470s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" returned: 0 in 0.157s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] <== create_volume: return (733ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b730e342-5cd9-4758-ba81-99387e035eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32568fee-077b-41ed-8d02-f17bfe5abf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:27:48 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Volume volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab (cc1ff7cf-c1a8-4f81-9856-f04a095834ab): created successfully
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32568fee-077b-41ed-8d02-f17bfe5abf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:27:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Flow 'volume_create_manager' (89569d7d-8747-4eaa-9fc1-41883df07c85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:27:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-06f42950-ffba-4b72-ae9a-9a00aa62d812 tempest-VolumesListTestJSON-1412368237 None] Created volume successfully.
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-cc1ff7cf-c1a8-4f81-9856-f04a095834ab-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-cc1ff7cf-c1a8-4f81-9856-f04a095834ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-quobyte-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" acquired by "delete_volume" :: waited 0.016s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3abbd3-5e1d-4c4c-b832-542364bd976d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" returned: 0 in 0.782s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" returned: 0 in 0.152s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-cc1ff7cf-c1a8-4f81-9856-f04a095834ab" released by "delete_volume" :: held 1.142s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Created reservations ['a08d836f-fb1e-4a15-bb74-a5092870cf0f', '5f80792a-00fd-473e-97a2-bdd4d1261ce6', '4dbc6bec-fe51-49f2-b042-393f9bffe896', '0ced763f-5e13-4efd-b60c-dcf9d67df472'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.151s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:55 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Deleted volume successfully.
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-33705ffe-6143-43c9-ac4b-608eed959048 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-cc1ff7cf-c1a8-4f81-9856-f04a095834ab-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-5167fe0f-92f4-468d-8d14-9906fc6d50f8-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-5167fe0f-92f4-468d-8d14-9906fc6d50f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-quobyte-5167fe0f-92f4-468d-8d14-9906fc6d50f8" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-5167fe0f-92f4-468d-8d14-9906fc6d50f8" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f29e2ae-67c7-40b5-986d-e64c03a3bf09]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8" returned: 0 in 0.511s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5167fe0f-92f4-468d-8d14-9906fc6d50f8" returned: 0 in 0.111s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-5167fe0f-92f4-468d-8d14-9906fc6d50f8" released by "delete_volume" :: held 0.797s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Created reservations ['4da52a58-ac71-4f9e-bcec-19c35dcb4790', '532ff7fd-e1f5-428c-b364-5b264afa8217', '8bf15446-4c79-4d2b-b6b4-daf94fcb86b8', 'dcef74e6-4879-401a-abc2-f3d27a461019'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.097s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:27:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Deleted volume successfully.
Sep 10 19:27:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c23d353f-4622-465e-abfb-619d4b80f624 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-5167fe0f-92f4-468d-8d14-9906fc6d50f8-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-b51afd2a-d408-424f-9948-6436c8d771fc-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-b51afd2a-d408-424f-9948-6436c8d771fc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "cinder-quobyte-b51afd2a-d408-424f-9948-6436c8d771fc" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-b51afd2a-d408-424f-9948-6436c8d771fc" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1695dcd4-01d0-4740-8d48-39fdd361ffcf]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:27:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc" returned: 0 in 0.465s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b51afd2a-d408-424f-9948-6436c8d771fc" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-quobyte-b51afd2a-d408-424f-9948-6436c8d771fc" released by "delete_volume" :: held 0.726s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Created reservations ['ed04a51d-88d2-4f31-a986-e3d332b6d9ed', '52529ca5-9c98-493d-8e96-bf4a1dc4267b', '09c8dfb2-b58f-4831-afdf-3cd6876474ab', '48966cb8-39a9-47ec-ace8-2188c3c2e514'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.115s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:27:59 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Deleted volume successfully.
Sep 10 19:28:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-65bd15b0-13e1-4425-a734-cc1c5c95be59 tempest-VolumesListTestJSON-1412368237 None] Lock "cinder-b51afd2a-d408-424f-9948-6436c8d771fc-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:28:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=19,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=18,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.202s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:28:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (9905b050-51b3-4e0b-a101-c89f7bd4f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abdd66-8599-4d60-b738-b59d32f2bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abdd66-8599-4d60-b738-b59d32f2bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-478979743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea61a553-8d31-41d7-a1e5-ff586dc8e8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:50Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28f5084-c526-4a86-8e76-e65ff64823e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b28f5084-c526-4a86-8e76-e65ff64823e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244f3509-e1c4-42f6-a2f4-244377159153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244f3509-e1c4-42f6-a2f4-244377159153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea61a553-8d31-41d7-a1e5-ff586dc8e8ae', 'volume_name': 'volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0464439-5d90-44b0-97c2-454d5d847b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0464439-5d90-44b0-97c2-454d5d847b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1413d07-b0aa-4088-abe9-40ec5f99af5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:50 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Volume ea61a553-8d31-41d7-a1e5-ff586dc8e8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae', 'volume_size': 1}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-478979743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea61a553-8d31-41d7-a1e5-ff586dc8e8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:28:50Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Creating volume ea61a553-8d31-41d7-a1e5-ff586dc8e8ae {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:28:50 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:28:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:51 devstack quobyte-client[82905]: System call of process 93520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:28:51 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=73, name=volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae 1073741824" returned: 0 in 0.445s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" returned: 0 in 0.102s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] <== create_volume: return (625ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.637s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1413d07-b0aa-4088-abe9-40ec5f99af5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f110388-9888-4ff5-b8c7-65bf1216df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:28:51 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Volume volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae (ea61a553-8d31-41d7-a1e5-ff586dc8e8ae): created successfully
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f110388-9888-4ff5-b8c7-65bf1216df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:28:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (9905b050-51b3-4e0b-a101-c89f7bd4f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:28:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f22158ed-38d5-4e86-a1db-e25ff79a53b6 tempest-AttachVolumeTestJSON-338486035 None] Created volume successfully.
Sep 10 19:28:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:28:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:28:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bb5233-437a-4a6b-adb4-2bcc7f515a32]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:28:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:28:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" returned: 0 in 0.885s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:28:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.968s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:28:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e22f52f7-49af-4358-abe7-12d49f3a9e10', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:28:59 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:28:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-f9afec50-e694-4d61-aa61-473c35a65eda req-9692bfc9-3a55-4589-9506-281594a64578 tempest-AttachVolumeTestJSON-338486035 None] attachment_update completed successfully.
Sep 10 19:29:09 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:29:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:10 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Flow 'volume_create_manager' (1632ff88-aa52-445f-a681-6f0918a4a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed90f51-71ae-41f8-889d-8cac66a8be67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed90f51-71ae-41f8-889d-8cac66a8be67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-494727135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f62b7b7-efbf-4ad7-900f-c35014897d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9830331be443c2b691fb58d2edd297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:11Z,use_quota=True,user_id='ddca4f13c5b74888abac74cb75b5f70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a16884-ef58-4efc-94df-1d33f1af2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a16884-ef58-4efc-94df-1d33f1af2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ace146-156c-40b3-afcc-56b961a8c401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ace146-156c-40b3-afcc-56b961a8c401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f62b7b7-efbf-4ad7-900f-c35014897d58', 'volume_name': 'volume-8f62b7b7-efbf-4ad7-900f-c35014897d58', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef7b4c-a056-4845-940c-74c9e67a634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eef7b4c-a056-4845-940c-74c9e67a634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983f11b5-55ec-4127-8338-442933dd2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:11 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume 8f62b7b7-efbf-4ad7-900f-c35014897d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f62b7b7-efbf-4ad7-900f-c35014897d58', 'volume_size': 1}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-494727135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f62b7b7-efbf-4ad7-900f-c35014897d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d9830331be443c2b691fb58d2edd297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:30:11Z,use_quota=True,user_id='ddca4f13c5b74888abac74cb75b5f70a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Creating volume 8f62b7b7-efbf-4ad7-900f-c35014897d58 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:30:11 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:30:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:11 devstack quobyte-client[82905]: System call of process 94714 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:11 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=74, name=volume-8f62b7b7-efbf-4ad7-900f-c35014897d58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 1073741824" returned: 0 in 0.492s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58" returned: 0 in 0.156s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] <== create_volume: return (719ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983f11b5-55ec-4127-8338-442933dd2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f62b7b7-efbf-4ad7-900f-c35014897d58', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65fb700-b413-4c99-966e-918ade58cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:30:12 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 (8f62b7b7-efbf-4ad7-900f-c35014897d58): created successfully
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65fb700-b413-4c99-966e-918ade58cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:30:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Flow 'volume_create_manager' (1632ff88-aa52-445f-a681-6f0918a4a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:30:12 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-32f68bb4-a130-41b1-90ff-94ed157fd675 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Created volume successfully.
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8256ac-9915-4dff-a908-51983792bc3c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:17 devstack quobyte-client[82905]: System call of process 94726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58" returned: 0 in 0.452s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.519s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-8f62b7b7-efbf-4ad7-900f-c35014897d58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '653ab4a8-2b34-4ce4-b48d-3ae05b93b1e8', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:30:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-086da7c9-e2fe-4193-b99f-942ed6f6afa8 req-e6ff67d9-03f9-4521-a067-100485b23d0a tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] attachment_update completed successfully.
Sep 10 19:30:28 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:28 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.083s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-0112e3b6-f1c3-4ecd-be1a-0047faa04086 req-ac4ce177-71e1-4d9f-88c5-83f3c225940b tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:48 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-0112e3b6-f1c3-4ecd-be1a-0047faa04086 req-ac4ce177-71e1-4d9f-88c5-83f3c225940b tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-0112e3b6-f1c3-4ecd-be1a-0047faa04086 req-ac4ce177-71e1-4d9f-88c5-83f3c225940b tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Terminate volume connection completed successfully.
Sep 10 19:30:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-0112e3b6-f1c3-4ecd-be1a-0047faa04086 req-ac4ce177-71e1-4d9f-88c5-83f3c225940b tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Deleting attachment 653ab4a8-2b34-4ce4-b48d-3ae05b93b1e8. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "cinder-8f62b7b7-efbf-4ad7-900f-c35014897d58-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "cinder-8f62b7b7-efbf-4ad7-900f-c35014897d58-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "cinder-quobyte-8f62b7b7-efbf-4ad7-900f-c35014897d58" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "cinder-quobyte-8f62b7b7-efbf-4ad7-900f-c35014897d58" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a6048-b79a-4adb-abab-8f40a094a308]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:30:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58" returned: 0 in 0.438s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8f62b7b7-efbf-4ad7-900f-c35014897d58" returned: 0 in 0.084s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "cinder-quobyte-8f62b7b7-efbf-4ad7-900f-c35014897d58" released by "delete_volume" :: held 0.714s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:30:50 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Created reservations ['64c0c038-8a9b-47a2-9aa0-35deb08fd616', '2b0b5509-e5c4-495f-a03a-add0c1b30523', '2239dfc3-0d46-43a9-853b-dc74a388475d', '968f5833-5139-4ab8-8326-6343656b026d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.099s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:30:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Deleted volume successfully.
Sep 10 19:30:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8be0d3ec-a0e3-4323-acd5-764f22629a87 tempest-TestServerVolumeAttachScenarioOldVersion-1426197001 None] Lock "cinder-8f62b7b7-efbf-4ad7-900f-c35014897d58-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:31:01 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:01 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-32f92df2-0f6a-4867-a6b6-4be8995e9e98 req-deb33287-76e6-4c89-a00d-ab538571a375 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-32f92df2-0f6a-4867-a6b6-4be8995e9e98 req-deb33287-76e6-4c89-a00d-ab538571a375 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-32f92df2-0f6a-4867-a6b6-4be8995e9e98 req-deb33287-76e6-4c89-a00d-ab538571a375 tempest-AttachVolumeTestJSON-338486035 None] Terminate volume connection completed successfully.
Sep 10 19:31:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-32f92df2-0f6a-4867-a6b6-4be8995e9e98 req-deb33287-76e6-4c89-a00d-ab538571a375 tempest-AttachVolumeTestJSON-338486035 None] Deleting attachment e22f52f7-49af-4358-abe7-12d49f3a9e10. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:31:12 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:12 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.169s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:31:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Flow 'volume_create_manager' (6c80e5c8-8ed6-47f8-9531-43798c8d13e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9c18d7-e970-4e77-ac9b-618594fdddbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9c18d7-e970-4e77-ac9b-618594fdddbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-264631939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c1e2b5-8fdb-485d-8f99-323aeffcad2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46e48687c924411b986d0771759218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:58Z,use_quota=True,user_id='e707beebf2cd4631bc219c9f4e5f22f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b580dea8-9f21-4e34-9aaa-767311682ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b580dea8-9f21-4e34-9aaa-767311682ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa20c6-9f5e-4b73-af75-86f628787a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fa20c6-9f5e-4b73-af75-86f628787a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c1e2b5-8fdb-485d-8f99-323aeffcad2e', 'volume_name': 'volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be17b8f-90a7-4bbe-9fdc-51bf9b307f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be17b8f-90a7-4bbe-9fdc-51bf9b307f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96826127-40e1-4d40-927a-48cfb73ad5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:31:58 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume e4c1e2b5-8fdb-485d-8f99-323aeffcad2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e', 'volume_size': 1}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-264631939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c1e2b5-8fdb-485d-8f99-323aeffcad2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46e48687c924411b986d0771759218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:58Z,use_quota=True,user_id='e707beebf2cd4631bc219c9f4e5f22f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Creating volume e4c1e2b5-8fdb-485d-8f99-323aeffcad2e {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:31:58 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:31:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:31:58 devstack quobyte-client[82905]: System call of process 95086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:31:58 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=75, name=volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:31:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e 1073741824" returned: 0 in 1.011s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:31:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" returned: 0 in 0.559s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] <== create_volume: return (1641ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Flow 'volume_create_manager' (0cd74ae8-1e5e-4112-a229-96ae791e55af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32b9e6-5359-4505-8fc8-524f4cd5b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf32b9e6-5359-4505-8fc8-524f4cd5b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-370282523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266ce648-9e1f-4283-bddd-a19f0aa10e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46e48687c924411b986d0771759218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:59Z,use_quota=True,user_id='e707beebf2cd4631bc219c9f4e5f22f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407ac1f-c82a-4ad9-899a-e7d8ddaa361b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8407ac1f-c82a-4ad9-899a-e7d8ddaa361b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3446a2-4729-48dc-afba-eab4cd0600ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3446a2-4729-48dc-afba-eab4cd0600ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '266ce648-9e1f-4283-bddd-a19f0aa10e4f', 'volume_name': 'volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a442946-21cf-4745-a282-c20711fa03a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a442946-21cf-4745-a282-c20711fa03a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f1a19c-f6c8-4107-814c-b17bde927895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:00 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume 266ce648-9e1f-4283-bddd-a19f0aa10e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f', 'volume_size': 1}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-370282523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=266ce648-9e1f-4283-bddd-a19f0aa10e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c46e48687c924411b986d0771759218a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:31:59Z,use_quota=True,user_id='e707beebf2cd4631bc219c9f4e5f22f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Creating volume 266ce648-9e1f-4283-bddd-a19f0aa10e4f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:32:00 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:32:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:00 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=76, name=volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96826127-40e1-4d40-927a-48cfb73ad5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55838987-e7ec-4357-8ab8-3e9debfd5fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f 1073741824" returned: 0 in 0.721s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e (e4c1e2b5-8fdb-485d-8f99-323aeffcad2e): created successfully
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55838987-e7ec-4357-8ab8-3e9debfd5fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Flow 'volume_create_manager' (6c80e5c8-8ed6-47f8-9531-43798c8d13e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8055df09-9504-4d2f-881e-601e593f86b1 tempest-TestServerVolumeAttachmentScenario-729566046 None] Created volume successfully.
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f" returned: 0 in 0.726s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] <== create_volume: return (1574ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74f1a19c-f6c8-4107-814c-b17bde927895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15ee4dc-9b10-46df-82cf-3e134d7f9394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:32:02 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f (266ce648-9e1f-4283-bddd-a19f0aa10e4f): created successfully
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15ee4dc-9b10-46df-82cf-3e134d7f9394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:32:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Flow 'volume_create_manager' (0cd74ae8-1e5e-4112-a229-96ae791e55af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:32:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-274c4610-cd2b-4bf2-9ce1-fc89cc46524b tempest-TestServerVolumeAttachmentScenario-729566046 None] Created volume successfully.
Sep 10 19:32:12 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=6,cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:12 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:32:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:32:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.690s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:32:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.149s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231e8b4-bed9-44e6-b572-a4f61ca8862f]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" returned: 0 in 0.507s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.582s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '256ad75b-c9a5-4e40-a047-a216ceb2a658', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:33:43 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-f6d49555-8e0c-4485-be6e-bef4d491f106 req-b0af9d65-a774-469d-b340-aa9a28e68037 tempest-TestServerVolumeAttachmentScenario-729566046 None] attachment_update completed successfully.
Sep 10 19:33:53 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:33:53 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7ead09-5c53-41ed-acab-c3a041a7405c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f" returned: 0 in 0.399s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.456s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:33:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96ea6e44-2cbd-431f-ade4-1225faceceef', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:33:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:33:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-b2f692c2-ab3c-48e3-bab0-cc88a0c88c22 req-4e17a093-9aad-473f-b549-6b8766482249 tempest-TestServerVolumeAttachmentScenario-729566046 None] attachment_update completed successfully.
Sep 10 19:34:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:34:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:34:25 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (b008baa1-77e2-4f6d-9fde-39bab745c44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fc3a0-5657-420a-80df-906492831f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fc3a0-5657-420a-80df-906492831f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-467245429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af870f5a-2dc3-4eed-b110-7fed39b4b6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:26Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0875ed-e11d-41e0-80c0-03744454c398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0875ed-e11d-41e0-80c0-03744454c398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330789ed-7ac6-4f33-9905-ef47f0aa7237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330789ed-7ac6-4f33-9905-ef47f0aa7237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af870f5a-2dc3-4eed-b110-7fed39b4b6b3', 'volume_name': 'volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd93cd9b-727f-4b61-bcc6-319b894fdb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd93cd9b-727f-4b61-bcc6-319b894fdb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac152f6-8c76-471c-967e-531a716864c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:25 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Volume af870f5a-2dc3-4eed-b110-7fed39b4b6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3', 'volume_size': 1}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-467245429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af870f5a-2dc3-4eed-b110-7fed39b4b6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:26Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Creating volume af870f5a-2dc3-4eed-b110-7fed39b4b6b3 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:25 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:34:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:25 devstack quobyte-client[82905]: System call of process 96083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:34:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-5919914f-0527-4370-a6fe-93c18f8381c3 req-5d300f4c-e58f-4b65-877b-8f113634b259 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:26 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=77, name=volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:34:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-5919914f-0527-4370-a6fe-93c18f8381c3 req-5d300f4c-e58f-4b65-877b-8f113634b259 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-5919914f-0527-4370-a6fe-93c18f8381c3 req-5d300f4c-e58f-4b65-877b-8f113634b259 tempest-TestServerVolumeAttachmentScenario-729566046 None] Terminate volume connection completed successfully.
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-5919914f-0527-4370-a6fe-93c18f8381c3 req-5d300f4c-e58f-4b65-877b-8f113634b259 tempest-TestServerVolumeAttachmentScenario-729566046 None] Deleting attachment 96ea6e44-2cbd-431f-ade4-1225faceceef. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 1073741824" returned: 0 in 0.427s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" returned: 0 in 0.137s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] <== create_volume: return (623ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ac152f6-8c76-471c-967e-531a716864c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b868a27f-00a9-4299-9d6c-b82d55495709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:26 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Volume volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 (af870f5a-2dc3-4eed-b110-7fed39b4b6b3): created successfully
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b868a27f-00a9-4299-9d6c-b82d55495709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (b008baa1-77e2-4f6d-9fde-39bab745c44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-79962d7a-af3d-4657-bbf3-4e124cd07b85 tempest-AttachVolumeTestJSON-338486035 None] Created volume successfully.
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f9a127-3581-482b-91ac-466b00e6140c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" returned: 0 in 0.447s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.500s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d0b654f-625b-47ec-b9cf-8fb4c12d97d4', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:34:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-b4bc5b5b-24ae-4ba0-9ad1-d5cf6ad5fbb9 req-13a9b0f7-c236-48e9-8309-9a89c19ca82d tempest-AttachVolumeTestJSON-338486035 None] attachment_update completed successfully.
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:34:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:39 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (3c6a9911-7679-451b-a09c-864a5280d9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc38f03c-ef8c-4139-af5e-577c4601c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc38f03c-ef8c-4139-af5e-577c4601c486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1199390176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78da50-84fd-4646-ad4b-13d274573bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:40Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b08d7e-a438-4e38-b215-9f2cbf7c9eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b08d7e-a438-4e38-b215-9f2cbf7c9eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b79542-d1cd-461d-927e-51333a0348f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b79542-d1cd-461d-927e-51333a0348f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa78da50-84fd-4646-ad4b-13d274573bee', 'volume_name': 'volume-fa78da50-84fd-4646-ad4b-13d274573bee', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79064b2a-0d19-41e4-9620-d58da2775c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79064b2a-0d19-41e4-9620-d58da2775c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf04951-e084-4f41-9613-a8e11a739e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Volume fa78da50-84fd-4646-ad4b-13d274573bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa78da50-84fd-4646-ad4b-13d274573bee', 'volume_size': 1}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1199390176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78da50-84fd-4646-ad4b-13d274573bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2560c4e8aa994ecc93238874bd83c51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:34:40Z,use_quota=True,user_id='af4f06b522824aff89baf90fffcb6676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Creating volume fa78da50-84fd-4646-ad4b-13d274573bee {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:34:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=78, name=volume-fa78da50-84fd-4646-ad4b-13d274573bee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee 1073741824" returned: 0 in 0.352s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee" returned: 0 in 0.085s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] <== create_volume: return (501ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.513s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf04951-e084-4f41-9613-a8e11a739e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa78da50-84fd-4646-ad4b-13d274573bee', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eded579-137f-4927-b1ab-b95268a1a818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:34:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Volume volume-fa78da50-84fd-4646-ad4b-13d274573bee (fa78da50-84fd-4646-ad4b-13d274573bee): created successfully
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eded579-137f-4927-b1ab-b95268a1a818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:34:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Flow 'volume_create_manager' (3c6a9911-7679-451b-a09c-864a5280d9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:34:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-aed2769e-25f9-4dfb-9601-e3e793b72749 tempest-AttachVolumeTestJSON-338486035 None] Created volume successfully.
Sep 10 19:34:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:34:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:34:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[284a87bf-3d93-4da5-acb5-155a6bf91be7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:34:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:34:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee" returned: 0 in 0.450s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:34:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.512s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:34:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-fa78da50-84fd-4646-ad4b-13d274573bee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bd2a0c0-6736-4771-90cc-cb9b8b91d516', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:34:46 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:46 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-349ff312-1b22-4825-9929-d93eca658efe req-b99e4c25-1611-4eed-8bc7-ec5b77e41868 tempest-AttachVolumeTestJSON-338486035 None] attachment_update completed successfully.
Sep 10 19:34:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-ddcfbd2f-8e5e-48cc-8872-c3b920a81c39 req-3d101898-a1e3-4fc6-ac51-6f6012b42d42 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-ddcfbd2f-8e5e-48cc-8872-c3b920a81c39 req-3d101898-a1e3-4fc6-ac51-6f6012b42d42 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:34:50 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-ddcfbd2f-8e5e-48cc-8872-c3b920a81c39 req-3d101898-a1e3-4fc6-ac51-6f6012b42d42 tempest-TestServerVolumeAttachmentScenario-729566046 None] Terminate volume connection completed successfully.
Sep 10 19:34:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-ddcfbd2f-8e5e-48cc-8872-c3b920a81c39 req-3d101898-a1e3-4fc6-ac51-6f6012b42d42 tempest-TestServerVolumeAttachmentScenario-729566046 None] Deleting attachment 256ad75b-c9a5-4e40-a047-a216ceb2a658. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:35:00 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:00 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "cinder-266ce648-9e1f-4283-bddd-a19f0aa10e4f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-266ce648-9e1f-4283-bddd-a19f0aa10e4f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "cinder-quobyte-266ce648-9e1f-4283-bddd-a19f0aa10e4f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-quobyte-266ce648-9e1f-4283-bddd-a19f0aa10e4f" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[283a9f7c-3ed5-4a68-9e17-4f46a9425f47]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f" returned: 0 in 0.453s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-266ce648-9e1f-4283-bddd-a19f0aa10e4f" returned: 0 in 0.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-quobyte-266ce648-9e1f-4283-bddd-a19f0aa10e4f" released by "delete_volume" :: held 0.731s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Created reservations ['61c53ecc-92f1-4a07-bfa3-5b908a3c9fdd', '3ed28488-a20a-420e-952b-8f9d9a3f140e', '8c4959b4-0612-4383-a2e4-6a011031c7fe', '34380314-7104-4460-840c-90649fe94403'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.077s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:05 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Deleted volume successfully.
Sep 10 19:35:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-470bfc6b-2558-4f82-8ad2-62dd3c13f486 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-266ce648-9e1f-4283-bddd-a19f0aa10e4f-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "cinder-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:07 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "cinder-quobyte-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-quobyte-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" acquired by "delete_volume" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e140de3-a3f3-4909-8089-139c383d1156]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" returned: 0 in 0.403s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" returned: 0 in 0.085s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-quobyte-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e" released by "delete_volume" :: held 0.636s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:07 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Created reservations ['7a2c94e6-77b1-48a0-a567-44176945ef2a', '9bd32d7b-2a86-430b-99a1-9063263b8bdd', '83e8c5be-944e-4d6e-9ea3-c7ce70d91749', 'e2ac3982-164e-48c0-8a8c-248375308544'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Deleted volume successfully.
Sep 10 19:35:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a8c23e3c-0760-4bcf-aa10-a93c1cbeb6e4 tempest-TestServerVolumeAttachmentScenario-729566046 None] Lock "cinder-e4c1e2b5-8fdb-485d-8f99-323aeffcad2e-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-c64413d0-84bd-4aef-866a-53c270f966b0 req-e278c34e-d45b-488e-a786-514e3cca3a9a tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-c64413d0-84bd-4aef-866a-53c270f966b0 req-e278c34e-d45b-488e-a786-514e3cca3a9a tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:15 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-c64413d0-84bd-4aef-866a-53c270f966b0 req-e278c34e-d45b-488e-a786-514e3cca3a9a tempest-AttachVolumeTestJSON-338486035 None] Terminate volume connection completed successfully.
Sep 10 19:35:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-c64413d0-84bd-4aef-866a-53c270f966b0 req-e278c34e-d45b-488e-a786-514e3cca3a9a tempest-AttachVolumeTestJSON-338486035 None] Deleting attachment 3d0b654f-625b-47ec-b9cf-8fb4c12d97d4. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:35:18 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:25 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:35:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (5610b156-ebb0-4999-b7ba-b62562821c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a87519-9585-46dd-9787-d1b9a8f31d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a87519-9585-46dd-9787-d1b9a8f31d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1858229812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cea85be-6d65-4f98-ba67-5adf63b4ad99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:26Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e213c365-6719-43c0-aba9-830cb87c38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e213c365-6719-43c0-aba9-830cb87c38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d95b30d-0ef1-47d0-b8ac-a8acae00980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d95b30d-0ef1-47d0-b8ac-a8acae00980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cea85be-6d65-4f98-ba67-5adf63b4ad99', 'volume_name': 'volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c888dad-06e5-4293-98e3-426f9e053f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c888dad-06e5-4293-98e3-426f9e053f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1034cd-2539-43ea-a3f4-563d91c61f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:26 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Volume 4cea85be-6d65-4f98-ba67-5adf63b4ad99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99', 'volume_size': 1}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1858229812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cea85be-6d65-4f98-ba67-5adf63b4ad99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:26Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Creating volume 4cea85be-6d65-4f98-ba67-5adf63b4ad99 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:26 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:26 devstack quobyte-client[82905]: System call of process 96281 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:26 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=79, name=volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 1073741824" returned: 0 in 0.570s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99" returned: 0 in 0.274s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] <== create_volume: return (896ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (b8637b68-f7a2-42ef-b48c-0551e697ef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd8efe-2c94-43fe-b9cf-0375e82fd986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1034cd-2539-43ea-a3f4-563d91c61f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9840f048-5100-4b5c-90dd-eccddfb3da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd8efe-2c94-43fe-b9cf-0375e82fd986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550584559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1750f233-461b-4e7e-aa45-4063f52977ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:27Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db1f9ad-559e-4bbc-be2b-97b933bb72b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9db1f9ad-559e-4bbc-be2b-97b933bb72b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59255bf9-f579-4edd-bfe6-e96e441b0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59255bf9-f579-4edd-bfe6-e96e441b0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1750f233-461b-4e7e-aa45-4063f52977ac', 'volume_name': 'volume-1750f233-461b-4e7e-aa45-4063f52977ac', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd079598-b0eb-4651-acd9-9c7fcdb8458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd079598-b0eb-4651-acd9-9c7fcdb8458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2b85a0-ecfd-4746-9578-02f1e38f2992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:27 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Volume 1750f233-461b-4e7e-aa45-4063f52977ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1750f233-461b-4e7e-aa45-4063f52977ac', 'volume_size': 1}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-550584559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1750f233-461b-4e7e-aa45-4063f52977ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:27Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Creating volume 1750f233-461b-4e7e-aa45-4063f52977ac {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:27 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:27 devstack quobyte-client[82905]: System call of process 96286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Volume volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 (4cea85be-6d65-4f98-ba67-5adf63b4ad99): created successfully
Sep 10 19:35:28 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=80, name=volume-1750f233-461b-4e7e-aa45-4063f52977ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9840f048-5100-4b5c-90dd-eccddfb3da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (5610b156-ebb0-4999-b7ba-b62562821c4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:28 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-850aeb97-a4df-4ee9-a2e1-7bad03c7ee41 tempest-CreateVolumesFromImageTest-2096104982 None] Created volume successfully.
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac 1073741824" returned: 0 in 0.542s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (2bcdc27b-22d9-4ab5-9004-9015be92ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f83d894-812f-4155-8335-22896acef437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac" returned: 0 in 0.541s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f83d894-812f-4155-8335-22896acef437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253893785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dfd925-d44f-43e4-b1e4-969fe8934345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:28Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce426885-a918-4e90-ab5d-aae91b327433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce426885-a918-4e90-ab5d-aae91b327433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f808ea1-54e5-49b9-9999-5cc2aad921eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f808ea1-54e5-49b9-9999-5cc2aad921eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2dfd925-d44f-43e4-b1e4-969fe8934345', 'volume_name': 'volume-f2dfd925-d44f-43e4-b1e4-969fe8934345', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbf4c86-2a11-4fd3-8670-d533f55b14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbf4c86-2a11-4fd3-8670-d533f55b14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ccce3e-001f-449e-80f7-ca93fd567a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Volume f2dfd925-d44f-43e4-b1e4-969fe8934345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2dfd925-d44f-43e4-b1e4-969fe8934345', 'volume_size': 1}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1253893785',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2dfd925-d44f-43e4-b1e4-969fe8934345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:28Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Creating volume f2dfd925-d44f-43e4-b1e4-969fe8934345 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:29 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:29 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=81, name=volume-f2dfd925-d44f-43e4-b1e4-969fe8934345, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:29 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (39fcc5c1-5bc0-4662-aba6-4bf71bd0124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f85928-d964-4696-afcc-ccfe238b3f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f85928-d964-4696-afcc-ccfe238b3f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287673342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473fe37-768f-4e06-9116-fbdf814ab26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:29Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbf4d8f-54c8-4836-b848-e030984742a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddbf4d8f-54c8-4836-b848-e030984742a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cbd555-cf36-48f7-9591-987165d828bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cbd555-cf36-48f7-9591-987165d828bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0473fe37-768f-4e06-9116-fbdf814ab26b', 'volume_name': 'volume-0473fe37-768f-4e06-9116-fbdf814ab26b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fffc4c-9f26-4435-8ecc-5d02fac57bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fffc4c-9f26-4435-8ecc-5d02fac57bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878feb84-aa64-4fbe-bfb1-32447f4e0112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Volume 0473fe37-768f-4e06-9116-fbdf814ab26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0473fe37-768f-4e06-9116-fbdf814ab26b', 'volume_size': 1}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 1073741824" returned: 0 in 0.658s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2b85a0-ecfd-4746-9578-02f1e38f2992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1750f233-461b-4e7e-aa45-4063f52977ac', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f781a85-75d0-40ce-93fb-91d9b2823c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345" returned: 0 in 0.363s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] <== create_volume: return (1043ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-287673342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0473fe37-768f-4e06-9116-fbdf814ab26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:29Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Creating volume 0473fe37-768f-4e06-9116-fbdf814ab26b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:30 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:30 devstack quobyte-client[82905]: System call of process 96296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:30 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=82, name=volume-0473fe37-768f-4e06-9116-fbdf814ab26b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:30 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (71864252-28bb-4191-833d-a6d19675ff9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e03a679-0c17-4779-b8d6-541f605265ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Volume volume-1750f233-461b-4e7e-aa45-4063f52977ac (1750f233-461b-4e7e-aa45-4063f52977ac): created successfully
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f781a85-75d0-40ce-93fb-91d9b2823c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (b8637b68-f7a2-42ef-b48c-0551e697ef6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ccce3e-001f-449e-80f7-ca93fd567a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2dfd925-d44f-43e4-b1e4-969fe8934345', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03d17f5-c921-4245-b617-0d25fa426bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b32637de-448e-438a-a131-60c9545dedd7 tempest-CreateVolumesFromImageTest-2096104982 None] Created volume successfully.
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e03a679-0c17-4779-b8d6-541f605265ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530185974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:29Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382c8631-c9b5-4f67-87e1-76a6557d3b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382c8631-c9b5-4f67-87e1-76a6557d3b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844b35f8-59d1-4887-b130-41f878a90c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844b35f8-59d1-4887-b130-41f878a90c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e', 'volume_name': 'volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9a0520-9a7f-4e82-a622-994cbd0cddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d9a0520-9a7f-4e82-a622-994cbd0cddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c00012-7ed9-4f6c-95bc-8a27c56a2bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Volume 6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e', 'volume_size': 1}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Volume volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 (f2dfd925-d44f-43e4-b1e4-969fe8934345): created successfully
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03d17f5-c921-4245-b617-0d25fa426bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (2bcdc27b-22d9-4ab5-9004-9015be92ffab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b 1073741824" returned: 0 in 0.693s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1e877d74-724a-4717-b0bb-e1ef85ba6b83 tempest-CreateVolumesFromImageTest-2096104982 None] Created volume successfully.
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b" returned: 0 in 0.280s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] <== create_volume: return (1012ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1530185974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955dc82fd1ec43779177be5878cf2336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:29Z,use_quota=True,user_id='a4c33c08cf4b41b9bf5ba7abd0ba30c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Creating volume 6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:31 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:31 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=83, name=volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878feb84-aa64-4fbe-bfb1-32447f4e0112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0473fe37-768f-4e06-9116-fbdf814ab26b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef452283-d6e8-4bdd-820b-b9e8c139df36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:31 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Volume volume-0473fe37-768f-4e06-9116-fbdf814ab26b (0473fe37-768f-4e06-9116-fbdf814ab26b): created successfully
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef452283-d6e8-4bdd-820b-b9e8c139df36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (39fcc5c1-5bc0-4662-aba6-4bf71bd0124a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e 1073741824" returned: 0 in 0.499s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1b09b20f-9ff0-450f-a235-49bc9c539d47 tempest-CreateVolumesFromImageTest-2096104982 None] Created volume successfully.
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" returned: 0 in 0.215s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c00012-7ed9-4f6c-95bc-8a27c56a2bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8493243-064b-45d4-8ba5-a5e53dae21be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Volume volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e (6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e): created successfully
Sep 10 19:35:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8493243-064b-45d4-8ba5-a5e53dae21be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Flow 'volume_create_manager' (71864252-28bb-4191-833d-a6d19675ff9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:32 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f3e7b314-28a6-4019-8f73-d3f4bb624c8d tempest-CreateVolumesFromImageTest-2096104982 None] Created volume successfully.
Sep 10 19:35:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-quobyte-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf786f4-03f3-45e1-9396-530ac0061f75]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" returned: 0 in 0.452s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e" released by "delete_volume" :: held 0.698s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Created reservations ['91282381-1d0a-46e1-a0af-304519b94c4d', '066e4f94-6683-4b15-a5b4-ed1b583c22d9', '56a818ff-b21e-4941-a6a2-e06741e03e64', '3e3498c8-152c-450e-a290-f34b49b240ba'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.099s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Deleted volume successfully.
Sep 10 19:35:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e45e55df-1a8d-44ea-8323-767ab0fbcc49 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-6c9cf686-4a44-40e4-9f80-ab5ee56ccc3e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-0473fe37-768f-4e06-9116-fbdf814ab26b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-0473fe37-768f-4e06-9116-fbdf814ab26b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-quobyte-0473fe37-768f-4e06-9116-fbdf814ab26b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-0473fe37-768f-4e06-9116-fbdf814ab26b" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c739c-3e34-4ff3-b2d5-11e516a33e49]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b" returned: 0 in 0.435s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0473fe37-768f-4e06-9116-fbdf814ab26b" returned: 0 in 0.104s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-0473fe37-768f-4e06-9116-fbdf814ab26b" released by "delete_volume" :: held 0.673s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Created reservations ['f2fbc0bc-42a6-4091-ac97-5db954ac7846', 'f617eac8-f827-452d-94cd-7331dea9fd39', 'c2244465-32e0-49bb-b85c-659237519171', '26e48981-ef85-42a7-b694-b046afa616ae'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.105s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:36 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Deleted volume successfully.
Sep 10 19:35:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-554e1be0-ef98-418f-9ae1-fc099f5e5bd7 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-0473fe37-768f-4e06-9116-fbdf814ab26b-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.098s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-f2dfd925-d44f-43e4-b1e4-969fe8934345-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-f2dfd925-d44f-43e4-b1e4-969fe8934345-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:37 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-quobyte-f2dfd925-d44f-43e4-b1e4-969fe8934345" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-f2dfd925-d44f-43e4-b1e4-969fe8934345" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8983cc43-8497-4e58-9331-45fb13eebcb4]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345" returned: 0 in 0.405s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2dfd925-d44f-43e4-b1e4-969fe8934345" returned: 0 in 0.084s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-f2dfd925-d44f-43e4-b1e4-969fe8934345" released by "delete_volume" :: held 0.651s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:38 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Created reservations ['ec832927-d9c2-4ef7-9437-157b0a02b1c2', 'e170bc84-04ba-44f0-adab-acdb8a5e2122', 'd4844952-8581-490e-98fb-2f3020187b2b', 'db2751e2-b8cb-4684-b40c-aac734cd3ff4'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Deleted volume successfully.
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0f1284bf-fab7-4ebe-9b26-3a95b023d4d2 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-f2dfd925-d44f-43e4-b1e4-969fe8934345-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-cd8be781-cdb0-4089-b14a-8ac8bf1bbae9 req-08a68ba0-781e-47a1-8884-27637fc42ba3 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-cd8be781-cdb0-4089-b14a-8ac8bf1bbae9 req-08a68ba0-781e-47a1-8884-27637fc42ba3 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-cd8be781-cdb0-4089-b14a-8ac8bf1bbae9 req-08a68ba0-781e-47a1-8884-27637fc42ba3 tempest-AttachVolumeTestJSON-338486035 None] Terminate volume connection completed successfully.
Sep 10 19:35:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-cd8be781-cdb0-4089-b14a-8ac8bf1bbae9 req-08a68ba0-781e-47a1-8884-27637fc42ba3 tempest-AttachVolumeTestJSON-338486035 None] Deleting attachment 9bd2a0c0-6736-4771-90cc-cb9b8b91d516. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-1750f233-461b-4e7e-aa45-4063f52977ac-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-1750f233-461b-4e7e-aa45-4063f52977ac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-quobyte-1750f233-461b-4e7e-aa45-4063f52977ac" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-1750f233-461b-4e7e-aa45-4063f52977ac" acquired by "delete_volume" :: waited 0.016s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[384626ac-d44a-4e6f-b595-7ef8dbe2ddeb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac" returned: 0 in 0.476s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-1750f233-461b-4e7e-aa45-4063f52977ac" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-1750f233-461b-4e7e-aa45-4063f52977ac" released by "delete_volume" :: held 0.737s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Created reservations ['74970477-1d11-4c31-81cd-8a7d6415a9a2', '57cc69cf-30af-4b08-9e35-07d42c511656', '3196b78d-c0c5-43f6-84ac-eadf438a0f9e', 'ee05c154-f462-44c4-8662-d6b948b171c5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.115s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Deleted volume successfully.
Sep 10 19:35:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9238fb44-8755-4345-8021-3f2a45296f36 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-1750f233-461b-4e7e-aa45-4063f52977ac-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-4cea85be-6d65-4f98-ba67-5adf63b4ad99-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-4cea85be-6d65-4f98-ba67-5adf63b4ad99-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "cinder-quobyte-4cea85be-6d65-4f98-ba67-5adf63b4ad99" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-4cea85be-6d65-4f98-ba67-5adf63b4ad99" acquired by "delete_volume" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16245c6d-9868-4c0a-b755-347fa039a58a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99" returned: 0 in 0.622s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cea85be-6d65-4f98-ba67-5adf63b4ad99" returned: 0 in 0.331s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-quobyte-4cea85be-6d65-4f98-ba67-5adf63b4ad99" released by "delete_volume" :: held 1.343s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Created reservations ['b68bff7a-1222-4433-a2d6-f329b2dbf880', '13a98348-d72d-4434-aefc-9543eb66bdca', '80f47e1d-e152-499b-8cf5-8f191974a6c8', 'a519dc44-92dd-4aac-9b7e-e39beb4dc8ee'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.259s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:45 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Deleted volume successfully.
Sep 10 19:35:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0669936c-218b-464a-80ef-d9143824f1e6 tempest-CreateVolumesFromImageTest-2096104982 None] Lock "cinder-4cea85be-6d65-4f98-ba67-5adf63b4ad99-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:50 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (08530723-a11c-4f4f-bc22-507cd7acf47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6786973-dd0f-46ed-87f2-b8dd4a7673ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6786973-dd0f-46ed-87f2-b8dd4a7673ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264061401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c78cf6b-79c5-4206-bb9b-37a37d703069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:50Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf300cf9-fbcb-451f-9e4b-ba7eeab8e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf300cf9-fbcb-451f-9e4b-ba7eeab8e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbd4dcc-9cb3-4ede-a644-e980991b1c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbd4dcc-9cb3-4ede-a644-e980991b1c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c78cf6b-79c5-4206-bb9b-37a37d703069', 'volume_name': 'volume-5c78cf6b-79c5-4206-bb9b-37a37d703069', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c66a13-e66f-4ef4-9e2a-0eb5854b4b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c66a13-e66f-4ef4-9e2a-0eb5854b4b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e130a7-bf80-4a81-b596-d4de173a7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:50 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume 5c78cf6b-79c5-4206-bb9b-37a37d703069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c78cf6b-79c5-4206-bb9b-37a37d703069', 'volume_size': 1}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1264061401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c78cf6b-79c5-4206-bb9b-37a37d703069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:50Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume 5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:50 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:50 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=84, name=volume-5c78cf6b-79c5-4206-bb9b-37a37d703069, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 1073741824" returned: 0 in 0.392s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069" returned: 0 in 0.086s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (547ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.558s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e130a7-bf80-4a81-b596-d4de173a7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c78cf6b-79c5-4206-bb9b-37a37d703069', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d257397-786e-4e4f-b49a-dab96046888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:51 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 (5c78cf6b-79c5-4206-bb9b-37a37d703069): created successfully
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d257397-786e-4e4f-b49a-dab96046888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (08530723-a11c-4f4f-bc22-507cd7acf47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0f2c683f-372d-4833-8025-5f72646d07f0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-fa78da50-84fd-4646-ad4b-13d274573bee-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-fa78da50-84fd-4646-ad4b-13d274573bee-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-quobyte-fa78da50-84fd-4646-ad4b-13d274573bee" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating offline snapshot 7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 of volume 5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f0f7f5-6af4-4cb9-84f7-16bc698b84bc]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-fa78da50-84fd-4646-ad4b-13d274573bee" acquired by "delete_volume" :: waited 0.154s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b51a9c1-948b-46a8-bf1c-072edec8cb79]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069" returned: 0 in 0.536s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack quobyte-client[82905]: System call of process 96422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee" returned: 0 in 0.521s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=85, name=volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 1G" returned: 0 in 0.336s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fa78da50-84fd-4646-ad4b-13d274573bee" returned: 0 in 0.222s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img rebase -u -b volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.195s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:35:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-fa78da50-84fd-4646-ad4b-13d274573bee" released by "delete_volume" :: held 1.120s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.268s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.232s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.info" returned: 0 in 0.285s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Created reservations ['4a51f931-aa4b-41e7-b79b-1023eb6ebc66', '4d318b2e-e6f5-45cc-a1d1-d49e601eb859', '7a306883-aa24-4281-b49f-b879ff207239', '352ad706-d19f-46c5-826b-118d89923154'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:35:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.info" returned: 0 in 0.240s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9fb0d4e3-d8c8-4176-9937-9a7ab22430ef tempest-CreateVolumesFromSnapshotTest-1793892093 None] Create snapshot completed successfully
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.089s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:35:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Deleted volume successfully.
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-0ef8ec16-af5c-4cef-9468-69a8adb5169b tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-fa78da50-84fd-4646-ad4b-13d274573bee-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-af870f5a-2dc3-4eed-b110-7fed39b4b6b3-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-af870f5a-2dc3-4eed-b110-7fed39b4b6b3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:57 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-quobyte-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" acquired by "delete_volume" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea33b4f-9937-4cf8-b41f-19dab280fb5e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:57 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (a5aba8af-0a62-42bc-af42-0fd1d29ca989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e07b3ff-ffc9-4a74-9177-3c6558e71065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e07b3ff-ffc9-4a74-9177-3c6558e71065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070606627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f05354-31c7-4edb-878f-a4e12261fdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:57Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b476ff-5d9c-44ae-8f82-cb9269bee2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b476ff-5d9c-44ae-8f82-cb9269bee2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8e06a8-2432-4181-964b-180ce7995847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8e06a8-2432-4181-964b-180ce7995847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f05354-31c7-4edb-878f-a4e12261fdf7', 'volume_name': 'volume-c5f05354-31c7-4edb-878f-a4e12261fdf7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7e80e3-fb43-4ea8-ae8b-cd8d97399451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7e80e3-fb43-4ea8-ae8b-cd8d97399451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f54665-3ab3-42fc-8e92-f9c6952ec9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:57 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume c5f05354-31c7-4edb-878f-a4e12261fdf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f05354-31c7-4edb-878f-a4e12261fdf7', 'volume_size': 1}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2070606627',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f05354-31c7-4edb-878f-a4e12261fdf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:57Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume c5f05354-31c7-4edb-878f-a4e12261fdf7 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:57 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:58 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=87, name=volume-c5f05354-31c7-4edb-878f-a4e12261fdf7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:35:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" returned: 0 in 1.145s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (a75a59f6-d356-4571-ab57-b7004f0568eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028d0ab8-7aca-4761-963c-955b1cca200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 1073741824" returned: 0 in 1.144s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:59 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (10b89713-326c-4fa0-9059-a176c8656812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e408ef3-6b9d-4412-b7c0-fe17e0dcd879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" returned: 0 in 0.840s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e408ef3-6b9d-4412-b7c0-fe17e0dcd879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450356319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894d7a66-cb35-4b78-9e3c-1e7dbb4ab888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:58Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaa5f44-4906-49b8-886f-54972e43b5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eaa5f44-4906-49b8-886f-54972e43b5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3089ed2d-3727-4995-a5cb-b59d719e5ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3089ed2d-3727-4995-a5cb-b59d719e5ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894d7a66-cb35-4b78-9e3c-1e7dbb4ab888', 'volume_name': 'volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4cdbe0-9d34-4ee9-b144-7b8bcd4b0789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4cdbe0-9d34-4ee9-b144-7b8bcd4b0789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455c80e6-e989-4298-9cec-9d8401a756ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume 894d7a66-cb35-4b78-9e3c-1e7dbb4ab888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888', 'volume_size': 1}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:59 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (61f16459-31dd-48cf-9029-015e9e16b846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6496b1-e178-4f19-a64d-a53b66250509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028d0ab8-7aca-4761-963c-955b1cca200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28209035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9e5da-5401-4b6b-b246-e4d23c3a5347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:58Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d33454-4819-4f97-9751-177307f0e397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d33454-4819-4f97-9751-177307f0e397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be823f38-d652-4d92-89e3-4ed5dbf7399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be823f38-d652-4d92-89e3-4ed5dbf7399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb9e5da-5401-4b6b-b246-e4d23c3a5347', 'volume_name': 'volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d445c52-057a-4971-b261-5f2b3b3d4ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d445c52-057a-4971-b261-5f2b3b3d4ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcbfdc1-bdf3-4a08-a8c5-e47b6e772265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume 2fb9e5da-5401-4b6b-b246-e4d23c3a5347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347', 'volume_size': 1}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6496b1-e178-4f19-a64d-a53b66250509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1085310354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:59Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada6601a-a8a8-4c23-aead-cde764c408f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada6601a-a8a8-4c23-aead-cde764c408f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2636bc66-4201-4de6-ae2b-c30eb359c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2636bc66-4201-4de6-ae2b-c30eb359c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4', 'volume_name': 'volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c12911-e4e4-428e-83e3-a73bfccc3ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c12911-e4e4-428e-83e3-a73bfccc3ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebb5fcf-7d4e-4b68-afcc-0ec3acba2392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:35:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4', 'volume_size': 1}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-af870f5a-2dc3-4eed-b110-7fed39b4b6b3" released by "delete_volume" :: held 2.646s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7" returned: 0 in 0.789s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (2006ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-450356319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894d7a66-cb35-4b78-9e3c-1e7dbb4ab888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:58Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume 894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:35:59 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:35:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:00 devstack quobyte-client[82905]: System call of process 96448 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:00 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=88, name=volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f54665-3ab3-42fc-8e92-f9c6952ec9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f05354-31c7-4edb-878f-a4e12261fdf7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b0a19-1d3d-419b-9f51-b94ddd8d57ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 (c5f05354-31c7-4edb-878f-a4e12261fdf7): created successfully
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b0a19-1d3d-419b-9f51-b94ddd8d57ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (a5aba8af-0a62-42bc-af42-0fd1d29ca989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (6f535942-773c-4587-9591-e44af1187212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106d7bc6-62b1-4930-8e08-27c3577acf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-41871ad5-4ca2-47ec-a66b-f6696d1e750d tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 1073741824" returned: 0 in 0.760s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106d7bc6-62b1-4930-8e08-27c3577acf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021812001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8950c22-c068-4ed1-a0b9-66a8e50e0692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:59Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfa08f5-ce2b-467d-82eb-e424372d4046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abfa08f5-ce2b-467d-82eb-e424372d4046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f007324d-8669-4ab0-9ce8-0a1182ed44df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f007324d-8669-4ab0-9ce8-0a1182ed44df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8950c22-c068-4ed1-a0b9-66a8e50e0692', 'volume_name': 'volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ee61ef-a343-4de0-8e59-df7656deaa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ee61ef-a343-4de0-8e59-df7656deaa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d86eba3-3648-407d-a034-222ddc878c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume c8950c22-c068-4ed1-a0b9-66a8e50e0692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692', 'volume_size': 1}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" returned: 0 in 0.560s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (1373ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.646s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28209035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fb9e5da-5401-4b6b-b246-e4d23c3a5347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:58Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume 2fb9e5da-5401-4b6b-b246-e4d23c3a5347 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:01 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:01 devstack quobyte-client[82905]: System call of process 96454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:01 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=89, name=volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455c80e6-e989-4298-9cec-9d8401a756ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964e8dbd-01eb-4001-aa1e-9bc03be44881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:01 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Created reservations ['2e7ec772-e6b7-4b58-b981-3847001c6eb9', '278bf0ac-0c52-48fe-9265-74933265a5c8', '959535af-1f98-444a-ab1f-9e5be3b9bd23', 'c677d04f-cc6b-4a70-b605-d0c2ac06ea44'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:02 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 (894d7a66-cb35-4b78-9e3c-1e7dbb4ab888): created successfully
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964e8dbd-01eb-4001-aa1e-9bc03be44881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (10b89713-326c-4fa0-9059-a176c8656812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 1073741824" returned: 0 in 0.675s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-6ad79a94-e217-46c2-a954-5a7b3549f552 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" returned: 0 in 0.435s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (1131ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.652s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1085310354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:59Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:02 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:02 devstack quobyte-client[82905]: System call of process 96458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:02 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=90, name=volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcbfdc1-bdf3-4a08-a8c5-e47b6e772265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af8d2df-0f99-4299-baf3-f51bdc881229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:03 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 (2fb9e5da-5401-4b6b-b246-e4d23c3a5347): created successfully
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af8d2df-0f99-4299-baf3-f51bdc881229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (a75a59f6-d356-4571-ab57-b7004f0568eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 1073741824" returned: 0 in 0.594s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.025s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cd3e7572-ea37-4eff-b8d8-98d511413cd5 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" returned: 0 in 0.672s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (1315ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.616s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:35:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021812001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8950c22-c068-4ed1-a0b9-66a8e50e0692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad025454186a4d1fa4364a379d1e0548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:35:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:35:59Z,use_quota=True,user_id='55c22695d4be46a6977f959a52822a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Creating volume c8950c22-c068-4ed1-a0b9-66a8e50e0692 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:03 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.620s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=91, name=volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae-delete_volume" acquired by "delete_volume" :: waited 0.399s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebb5fcf-7d4e-4b68-afcc-0ec3acba2392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bc7361-e43a-49d1-88c3-292eeb476cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Deleted volume successfully.
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 1073741824" returned: 0 in 0.572s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:04 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 (fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4): created successfully
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bc7361-e43a-49d1-88c3-292eeb476cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (61f16459-31dd-48cf-9029-015e9e16b846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692" returned: 0 in 0.448s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "cinder-quobyte-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] <== create_volume: return (1063ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9afb663d-d311-492c-8e3d-8d880597c8b2 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-af870f5a-2dc3-4eed-b110-7fed39b4b6b3-delete_volume" released by "delete_volume" :: held 7.999s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" acquired by "delete_volume" :: waited 0.055s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-be7faca2-0bfb-43a1-b5ee-7c8687ca989e tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84ef9e0-005e-4d7e-bba2-ac421e4e29d0]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d86eba3-3648-407d-a034-222ddc878c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e53225-4412-4f12-9bb4-f7f50e7bf30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:05 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 (c8950c22-c068-4ed1-a0b9-66a8e50e0692): created successfully
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e53225-4412-4f12-9bb4-f7f50e7bf30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Flow 'volume_create_manager' (6f535942-773c-4587-9591-e44af1187212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-da6440cd-5102-4e55-bf89-f0765bc32b33 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created volume successfully.
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" returned: 0 in 0.523s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" returned: 0 in 0.189s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-quobyte-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae" released by "delete_volume" :: held 0.931s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-c8950c22-c068-4ed1-a0b9-66a8e50e0692-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-c8950c22-c068-4ed1-a0b9-66a8e50e0692-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-c8950c22-c068-4ed1-a0b9-66a8e50e0692" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Created reservations ['a89b63d8-b5aa-4187-a099-7f5ce4273484', '9363aa21-880d-4790-8c8c-8a63e3ef8736', 'b5927973-62e0-473d-b781-8ffa31247cd9', 'af53686d-9724-4006-9374-f1712930e35b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-c8950c22-c068-4ed1-a0b9-66a8e50e0692" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9259817a-f9a5-400e-ba18-a26d3b0d1dc3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692" returned: 0 in 0.680s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.260s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Deleted volume successfully.
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c8950c22-c068-4ed1-a0b9-66a8e50e0692" returned: 0 in 0.390s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-178c233b-4216-4dd5-83de-52d9ed37b9e5 tempest-AttachVolumeTestJSON-338486035 None] Lock "cinder-ea61a553-8d31-41d7-a1e5-ff586dc8e8ae-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-c8950c22-c068-4ed1-a0b9-66a8e50e0692" released by "delete_volume" :: held 1.239s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['403bdfbd-27f5-4e77-b8d6-71014b2b6b71', 'f435c069-dba8-4728-88ba-c2da8393924d', 'c81ba0d2-16ff-4dc9-9253-6df53bcc9162', '152adb55-f2bf-4b21-873d-58c19da0338c'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-16486e62-f9be-47f7-82f2-60c796803810 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-c8950c22-c068-4ed1-a0b9-66a8e50e0692-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" acquired by "delete_volume" :: waited 0.016s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b923da-0a32-47f3-b251-3bb1a14169b3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" returned: 0 in 0.584s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" returned: 0 in 0.139s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4" released by "delete_volume" :: held 0.904s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['08e45ade-5cc5-4905-9208-dacdfff222a5', '306a48f0-5b9a-40b5-a863-457745385256', '02f6feb9-6bcc-4da7-a6ab-532095b2a34b', '6d4c4352-cb7c-484d-87c2-37bb8322a3b8'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.139s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6226863c-01f4-4c77-86ce-cf8ba464173a tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-fb4c68d4-d5ea-48e8-ac6b-b89d03ac3da4-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb281e-6bae-4027-a11e-31ceb329f6b6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" returned: 0 in 0.513s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" returned: 0 in 0.111s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888" released by "delete_volume" :: held 0.800s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['bf872307-7028-4353-9b52-52f259f4e9b4', '34cc3288-9160-4ec8-a046-013d24e8d460', '5bd71685-1f84-4841-b04b-8a745ed4ee20', '6f04d193-ffb7-4528-8a13-1633f936e325'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.121s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:12 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-978f8a90-3a19-432a-8da5-58868e3e9b42 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-894d7a66-cb35-4b78-9e3c-1e7dbb4ab888-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-2fb9e5da-5401-4b6b-b246-e4d23c3a5347-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-2fb9e5da-5401-4b6b-b246-e4d23c3a5347-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:13 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[30392411-58b2-4ca0-96b4-3626e5bfae80]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" returned: 0 in 0.536s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" returned: 0 in 0.134s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-2fb9e5da-5401-4b6b-b246-e4d23c3a5347" released by "delete_volume" :: held 0.902s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['9c5dad2a-2757-4940-8118-b2fece10a01e', '2d51dbdf-20c1-4295-8670-5955c3cfc42c', 'ebd40816-b9b4-4997-bfa0-df670990f693', 'a09903fc-a691-4571-ad92-4f48e8b51c1c'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:15 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:15 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c27975bf-89d5-48fd-a118-5fb15bf6b760 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-2fb9e5da-5401-4b6b-b246-e4d23c3a5347-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-c5f05354-31c7-4edb-878f-a4e12261fdf7-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-c5f05354-31c7-4edb-878f-a4e12261fdf7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:16 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-c5f05354-31c7-4edb-878f-a4e12261fdf7" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-c5f05354-31c7-4edb-878f-a4e12261fdf7" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c26ff-caac-441f-8452-08797d8845cc]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7" returned: 0 in 0.528s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c5f05354-31c7-4edb-878f-a4e12261fdf7" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-c5f05354-31c7-4edb-878f-a4e12261fdf7" released by "delete_volume" :: held 0.842s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['eb912da9-380d-4e86-be77-2ff766df833a', 'd2ec5618-99c2-48c6-accc-aa81bb2caea5', '061b02ea-65f6-4fd3-be1a-645d3af4b0d2', '9405bcf8-8b9e-4f8c-9b51-8424beb06b0a'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.111s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:17 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-df61734a-9dea-4b70-8190-f3876498bdc0 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-c5f05354-31c7-4edb-878f-a4e12261fdf7-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleting offline snapshot 7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 of volume 5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] snapshot_file for this snap is: volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f3a11f-a5f9-4a45-8683-c647b191a5fe]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.558s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c78cf6b-79c5-4206-bb9b-37a37d703069(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[766d1141-4942-4e5a-a2d9-59a1e8d10556]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069" returned: 0 in 0.501s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.343s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=84,cinder:UPDATE=137,cinder:DELETE=10,cinder:INSERT=25 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069.7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" returned: 0 in 0.345s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609" released by "_delete_snapshot" :: held 2.152s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" released by "delete_snapshot" :: held 2.200s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:20 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Flow 'volume_create_manager' (e1e7860a-8c17-43a8-b396-236b20bebdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:20 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa70ffe3-a944-49a4-bd1f-af82102f4722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa70ffe3-a944-49a4-bd1f-af82102f4722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-681757913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d404615-a743-4e8e-abfa-8a5594096b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e6b1664ba147cea09338bde88c969b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:20Z,use_quota=True,user_id='792f4d94db0048cda6a1e390c4df190c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aee02e4-2886-4b2b-9af4-8cf1a03a6498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aee02e4-2886-4b2b-9af4-8cf1a03a6498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0334cda5-6edd-4f58-950f-4b8e04456f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0334cda5-6edd-4f58-950f-4b8e04456f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d404615-a743-4e8e-abfa-8a5594096b33', 'volume_name': 'volume-3d404615-a743-4e8e-abfa-8a5594096b33', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6b5b7e-644b-4b19-8f29-887643984c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6b5b7e-644b-4b19-8f29-887643984c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671caf03-2a05-4536-9173-0fefb9e4c668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:21 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume 3d404615-a743-4e8e-abfa-8a5594096b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d404615-a743-4e8e-abfa-8a5594096b33', 'volume_size': 1}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-681757913',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d404615-a743-4e8e-abfa-8a5594096b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e6b1664ba147cea09338bde88c969b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:20Z,use_quota=True,user_id='792f4d94db0048cda6a1e390c4df190c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Creating volume 3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:21 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:21 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=92, name=volume-3d404615-a743-4e8e-abfa-8a5594096b33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['0723298b-0d9e-4f9b-afd5-0c8354e5c3ba', 'c2d77e60-a3d8-48a1-bf47-c105f6542049', '984ee960-1763-4392-adb9-20f2738b835a', 'a300ea88-0a28-43d6-9533-226578c08626'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 1073741824" returned: 0 in 0.537s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33" returned: 0 in 0.305s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] <== create_volume: return (872ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671caf03-2a05-4536-9173-0fefb9e4c668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d404615-a743-4e8e-abfa-8a5594096b33', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad87ea6-ecf7-460b-81ad-f76eb9772a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:22 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume volume-3d404615-a743-4e8e-abfa-8a5594096b33 (3d404615-a743-4e8e-abfa-8a5594096b33): created successfully
Sep 10 19:36:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ad87ea6-ecf7-460b-81ad-f76eb9772a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Flow 'volume_create_manager' (e1e7860a-8c17-43a8-b396-236b20bebdec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-96e18c8b-fbd1-45a6-ad77-296eccc40175 req-59479b13-b6bc-4cca-917f-487edf83caef tempest-VolumesSnapshotsTestJSON-1637907574 None] Created volume successfully.
Sep 10 19:36:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Delete snapshot completed successfully.
Sep 10 19:36:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3eda8a99-d2c1-4abc-91eb-b63be1a74869 tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-7a8bb2a4-8d67-4e81-81f8-f6c14ed2d609-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-5c78cf6b-79c5-4206-bb9b-37a37d703069-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-5c78cf6b-79c5-4206-bb9b-37a37d703069-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:23 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[808cbf9f-9a72-4108-92fe-6cc6b9dec0ad]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:23 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Creating offline snapshot 7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac of volume 3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9b8522-c70b-4692-8c19-2db19727d4ca]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069" returned: 0 in 0.690s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5c78cf6b-79c5-4206-bb9b-37a37d703069" returned: 0 in 0.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-quobyte-5c78cf6b-79c5-4206-bb9b-37a37d703069" released by "delete_volume" :: held 1.033s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:24 devstack quobyte-client[82905]: System call of process 96517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33" returned: 0 in 0.738s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:24 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Created reservations ['a3938c91-26d3-4857-9507-eba0268f5733', 'a0ce8770-3dc1-49a6-aa94-11e84e541384', '21c3de1e-f32f-46b8-82ef-ac38a5fb7970', 'ba5b7398-1c32-4733-988a-bc31ea05cecb'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:24 devstack quobyte-client[82905]: System call of process 96523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:24 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=93, name=volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac 1G" returned: 0 in 0.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3d404615-a743-4e8e-abfa-8a5594096b33 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "qemu-img rebase -u -b volume-3d404615-a743-4e8e-abfa-8a5594096b33 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.249s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.204s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.246s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.info" returned: 0 in 0.396s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.250s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Deleted volume successfully.
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.info" returned: 0 in 0.411s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.952s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=137,cinder:SELECT=91,cinder:DELETE=16,cinder:INSERT=33 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:36:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a209494c-cfa3-42be-ac4c-d67f7e5885cd tempest-CreateVolumesFromSnapshotTest-1793892093 None] Lock "cinder-5c78cf6b-79c5-4206-bb9b-37a37d703069-delete_volume" released by "delete_volume" :: held 3.801s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-6bb36ac7-7290-49f7-b555-8d2195388343 req-0311e7b1-76c5-4c85-9e1c-a90f746c7404 tempest-VolumesSnapshotsTestJSON-1637907574 None] Create snapshot completed successfully
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "cinder-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "cinder-quobyte-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Deleting offline snapshot 7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac of volume 3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] snapshot_file for this snap is: volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd04cfcc-071c-48a7-a21f-ccb98c979ce4]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.472s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d404615-a743-4e8e-abfa-8a5594096b33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dea999-1a0a-4f6f-ade6-2f28e10ffd5d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33" returned: 0 in 0.494s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.301s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33.7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" returned: 0 in 0.382s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac" released by "_delete_snapshot" :: held 1.950s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:30 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (8a8a149d-a973-4697-aca9-f6285fde5d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163dfc2b-ceec-4396-987d-0de65567feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" released by "delete_snapshot" :: held 2.070s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163dfc2b-ceec-4396-987d-0de65567feed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672691156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49fcda6-689b-48aa-a412-836d34d8ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:30Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e83827f-07c8-40cd-a533-de8981c18ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e83827f-07c8-40cd-a533-de8981c18ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ddfd9-0811-4944-98b1-19e0038d19e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6ddfd9-0811-4944-98b1-19e0038d19e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49fcda6-689b-48aa-a412-836d34d8ddc3', 'volume_name': 'volume-d49fcda6-689b-48aa-a412-836d34d8ddc3', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8c0d85-2171-4d9f-b7fa-3b3d7a0524f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc8c0d85-2171-4d9f-b7fa-3b3d7a0524f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c31758b-ddd3-4995-9036-3165dceef18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume d49fcda6-689b-48aa-a412-836d34d8ddc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49fcda6-689b-48aa-a412-836d34d8ddc3', 'volume_size': 1}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-672691156',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49fcda6-689b-48aa-a412-836d34d8ddc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:30Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume d49fcda6-689b-48aa-a412-836d34d8ddc3 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:30 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:30 devstack quobyte-client[82905]: System call of process 96546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:30 devstack quobyte-client[82905]: System call of process 96546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:30 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=95, name=volume-d49fcda6-689b-48aa-a412-836d34d8ddc3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 1073741824" returned: 0 in 0.447s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3" returned: 0 in 0.191s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.quota [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Created reservations ['651ee228-35e5-4ed1-b3eb-081dce9682e7', 'e890b3f9-c3d6-4a36-bd7e-40f92f77f405', 'fe8850a0-1ef1-419e-8e27-6cd7f4733282', 'c142fdbc-24b9-4f1c-8500-7cb1baefca57'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c31758b-ddd3-4995-9036-3165dceef18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49fcda6-689b-48aa-a412-836d34d8ddc3', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ced4c4-1007-4e2d-a2df-0a947ffa14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:31 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 (d49fcda6-689b-48aa-a412-836d34d8ddc3): created successfully
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ced4c4-1007-4e2d-a2df-0a947ffa14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (8a8a149d-a973-4697-aca9-f6285fde5d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Delete snapshot completed successfully.
Sep 10 19:36:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-41e7539c-1c2c-49ff-a004-ca743ece2602 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-b39e6d4c-d8a6-4011-b293-88f2b58a1f47 req-34e433a7-4d80-45c3-8321-10274cb976ad tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-7ae59d2e-ae65-4fa9-83b9-abf85bbe0eac-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "cinder-3d404615-a743-4e8e-abfa-8a5594096b33-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-3d404615-a743-4e8e-abfa-8a5594096b33-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d165ff93-fee0-481f-8027-1288d8059718]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33" returned: 0 in 0.482s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3d404615-a743-4e8e-abfa-8a5594096b33" returned: 0 in 0.141s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-quobyte-3d404615-a743-4e8e-abfa-8a5594096b33" released by "delete_volume" :: held 1.061s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (16cfede4-b497-4e4a-a6f4-e7fa1319eb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b064245b-4cfa-4b68-aabe-572b55f19622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b064245b-4cfa-4b68-aabe-572b55f19622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916323568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fdb74b-11a7-4e42-bea5-9165aeb41b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:33Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27be5a74-e84c-41a3-b4df-eeaf28c2413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27be5a74-e84c-41a3-b4df-eeaf28c2413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af33e293-7e23-4653-832b-e2445f302f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af33e293-7e23-4653-832b-e2445f302f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fdb74b-11a7-4e42-bea5-9165aeb41b7b', 'volume_name': 'volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d989cc63-979e-4358-acf9-ad4b6995112a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d989cc63-979e-4358-acf9-ad4b6995112a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dede81-849b-4179-b0bc-1f0b43fba13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume f2fdb74b-11a7-4e42-bea5-9165aeb41b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b', 'volume_size': 1}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916323568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fdb74b-11a7-4e42-bea5-9165aeb41b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:33Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume f2fdb74b-11a7-4e42-bea5-9165aeb41b7b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:33 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:33 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=96, name=volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.quota [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Created reservations ['66bba1bf-d6f7-4c8a-8a02-2162f0205f1d', '2f37213c-7ff5-4c8e-a6b1-bbf48e99d7e4', '959f5093-2a4a-4d37-bc6a-4aac9382e76f', '28350930-82fd-4a0b-be70-8050770aef5e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:33 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (67ea52d2-2369-4ea0-a29d-916be9cade32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693cd6c6-b706-45a9-98ff-110d77cacc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b 1073741824" returned: 0 in 1.066s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693cd6c6-b706-45a9-98ff-110d77cacc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025302654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e791c2b-71e1-4d24-8b27-2dd4eb114154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:33Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f04831-c4b1-4609-bad7-d11b8afb6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f04831-c4b1-4609-bad7-d11b8afb6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831a275-4cf5-4a22-bf17-0162e38bfe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831a275-4cf5-4a22-bf17-0162e38bfe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e791c2b-71e1-4d24-8b27-2dd4eb114154', 'volume_name': 'volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7adb2b3-b65e-42a6-850e-069416015485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7adb2b3-b65e-42a6-850e-069416015485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a94291-0007-4818-8c14-3ad67deb083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:35 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume 2e791c2b-71e1-4d24-8b27-2dd4eb114154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154', 'volume_size': 1}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (d629f9b9-28e2-4aab-9918-89b52e8cb343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb89fa61-c14a-45d8-880c-e0a4e0c6bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" returned: 0 in 0.921s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (2031ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1025302654',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e791c2b-71e1-4d24-8b27-2dd4eb114154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:33Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume 2e791c2b-71e1-4d24-8b27-2dd4eb114154 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:35 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:35 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=97, name=volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (6dfab320-907c-4f23-aeeb-d20a83a34d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc593d57-fd80-4c05-8e1f-8151d47f3667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb89fa61-c14a-45d8-880c-e0a4e0c6bb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527845065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d523301c-08ec-4c65-ad9c-d4eb0ac7f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:34Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c0fbc7-e58e-406e-9fa8-897e5abe7d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c0fbc7-e58e-406e-9fa8-897e5abe7d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763a76b9-db1a-4e31-8be9-ba0f83dae03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763a76b9-db1a-4e31-8be9-ba0f83dae03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd523301c-08ec-4c65-ad9c-d4eb0ac7f19b', 'volume_name': 'volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650ee03c-72cb-4a9f-9c0c-a0c768cad02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650ee03c-72cb-4a9f-9c0c-a0c768cad02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d06ace-27ec-438f-bd66-1ca8e9407abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume d523301c-08ec-4c65-ad9c-d4eb0ac7f19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b', 'volume_size': 1}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21dede81-849b-4179-b0bc-1f0b43fba13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c1e12-398b-4d94-9e9c-0fd8db9441d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc593d57-fd80-4c05-8e1f-8151d47f3667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2031537918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21085e00-1409-421b-b89a-ce5b6e304718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:35Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328bf835-c320-4ba6-a0bb-2bc5a4419d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328bf835-c320-4ba6-a0bb-2bc5a4419d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ed41c6-90bc-455a-8230-c20f52a72348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ed41c6-90bc-455a-8230-c20f52a72348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21085e00-1409-421b-b89a-ce5b6e304718', 'volume_name': 'volume-21085e00-1409-421b-b89a-ce5b6e304718', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30e2871-65b6-45a8-a3ad-6aeee68c596f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30e2871-65b6-45a8-a3ad-6aeee68c596f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0fae66-16d8-4695-bdaa-e637356ceb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume 21085e00-1409-421b-b89a-ce5b6e304718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21085e00-1409-421b-b89a-ce5b6e304718', 'volume_size': 1}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 1073741824" returned: 0 in 0.888s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b (f2fdb74b-11a7-4e42-bea5-9165aeb41b7b): created successfully
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1c1e12-398b-4d94-9e9c-0fd8db9441d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (16cfede4-b497-4e4a-a6f4-e7fa1319eb30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (359439d9-f144-4c1d-bd50-881e4612e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd08ea1-62e6-4258-a822-e18dadbfda08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a042cd09-18a5-408e-a10d-2c815951179f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd08ea1-62e6-4258-a822-e18dadbfda08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1751258969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc714cdf-5083-46d7-bf67-ad1c41f0ddab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:35Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16478a1-1624-4758-a85a-da524f19f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16478a1-1624-4758-a85a-da524f19f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d9b3d5-2a4f-4d80-8291-c9c2155dec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d9b3d5-2a4f-4d80-8291-c9c2155dec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc714cdf-5083-46d7-bf67-ad1c41f0ddab', 'volume_name': 'volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7c631-3c95-49b7-a03e-fec8255b58e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e7c631-3c95-49b7-a03e-fec8255b58e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a5b60c-c724-4e12-b5f7-c97349227d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume fc714cdf-5083-46d7-bf67-ad1c41f0ddab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab', 'volume_size': 1}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154" returned: 0 in 1.308s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (2281ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527845065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d523301c-08ec-4c65-ad9c-d4eb0ac7f19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:34Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume d523301c-08ec-4c65-ad9c-d4eb0ac7f19b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:37 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:38 devstack quobyte-client[82905]: System call of process 96598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=98, name=volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a94291-0007-4818-8c14-3ad67deb083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a679-a169-4b62-bc52-e89b62c860f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.manager [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.973s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Deleted volume successfully.
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b 1073741824" returned: 0 in 0.633s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:38 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 (2e791c2b-71e1-4d24-8b27-2dd4eb114154): created successfully
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a679-a169-4b62-bc52-e89b62c860f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (67ea52d2-2369-4ea0-a29d-916be9cade32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-bab2f549-c7fc-4a98-8765-221874099142 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" returned: 0 in 0.465s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (1129ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-56e0fd7d-e396-4eef-bb53-801daa59bacd req-9bf05188-01ab-4457-be16-5aba1e8ab1f4 tempest-VolumesSnapshotsTestJSON-1637907574 None] Lock "cinder-3d404615-a743-4e8e-abfa-8a5594096b33-delete_volume" released by "delete_volume" :: held 7.215s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2031537918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21085e00-1409-421b-b89a-ce5b6e304718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:35Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume 21085e00-1409-421b-b89a-ce5b6e304718 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:39 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:39 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=99, name=volume-21085e00-1409-421b-b89a-ce5b6e304718, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d06ace-27ec-438f-bd66-1ca8e9407abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906c2546-8b01-4094-8673-91dd97cd2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718 1073741824" returned: 0 in 0.591s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:39 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b (d523301c-08ec-4c65-ad9c-d4eb0ac7f19b): created successfully
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (906c2546-8b01-4094-8673-91dd97cd2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (d629f9b9-28e2-4aab-9918-89b52e8cb343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718" returned: 0 in 0.416s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (1034ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.670s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1751258969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc714cdf-5083-46d7-bf67-ad1c41f0ddab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6d70866a3d043bca8d8fbefa7dfed9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:35Z,use_quota=True,user_id='54da79aaae694d70a45784f93103d6bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Creating volume fc714cdf-5083-46d7-bf67-ad1c41f0ddab {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a47ffbe3-4c42-432f-9ca0-d863a68d8222 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=100, name=volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0fae66-16d8-4695-bdaa-e637356ceb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21085e00-1409-421b-b89a-ce5b6e304718', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceee81c3-4b5d-4c74-94e1-57c5afee95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab 1073741824" returned: 0 in 0.571s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-21085e00-1409-421b-b89a-ce5b6e304718 (21085e00-1409-421b-b89a-ce5b6e304718): created successfully
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceee81c3-4b5d-4c74-94e1-57c5afee95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (6dfab320-907c-4f23-aeeb-d20a83a34d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" returned: 0 in 0.345s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] <== create_volume: return (963ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0ebd86ed-26f0-47a6-903d-a1f6dcb8945d tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48a5b60c-c724-4e12-b5f7-c97349227d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fed88d-7f2c-4c75-964f-aca4910cde40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab (fc714cdf-5083-46d7-bf67-ad1c41f0ddab): created successfully
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fed88d-7f2c-4c75-964f-aca4910cde40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Flow 'volume_create_manager' (359439d9-f144-4c1d-bd50-881e4612e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-76cb853f-5f0b-4d21-9d27-349f55d384f5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created volume successfully.
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-fc714cdf-5083-46d7-bf67-ad1c41f0ddab-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Flow 'volume_create_manager' (8f3410cc-3164-4dfb-af4d-36e2bf60b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9830100a-5ee1-419a-9d8a-5b9418f10886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9830100a-5ee1-419a-9d8a-5b9418f10886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-255431206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3816bb5-7996-4029-bed0-63ced3eabc7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d1b19c1164403a88ada436ba04dea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:41Z,use_quota=True,user_id='309abed7ce2e4034963c47b7e4c3d411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fe1365-8b15-49a0-a0d4-4e323280feb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fe1365-8b15-49a0-a0d4-4e323280feb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f386ad96-ace8-4261-ac55-cca6159ce135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f386ad96-ace8-4261-ac55-cca6159ce135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3816bb5-7996-4029-bed0-63ced3eabc7e', 'volume_name': 'volume-d3816bb5-7996-4029-bed0-63ced3eabc7e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8018e1-d34f-4113-b507-f6d1f22ff365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8018e1-d34f-4113-b507-f6d1f22ff365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde20448-5750-420d-a724-138d50629e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Volume d3816bb5-7996-4029-bed0-63ced3eabc7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3816bb5-7996-4029-bed0-63ced3eabc7e', 'volume_size': 1}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-255431206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3816bb5-7996-4029-bed0-63ced3eabc7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0d1b19c1164403a88ada436ba04dea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:41Z,use_quota=True,user_id='309abed7ce2e4034963c47b7e4c3d411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Creating volume d3816bb5-7996-4029-bed0-63ced3eabc7e {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:41 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-fc714cdf-5083-46d7-bf67-ad1c41f0ddab-delete_volume" acquired by "delete_volume" :: waited 0.316s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:41 devstack quobyte-client[82905]: System call of process 96611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:41 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=101, name=volume-d3816bb5-7996-4029-bed0-63ced3eabc7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e 1073741824" returned: 0 in 0.469s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e" returned: 0 in 0.368s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] <== create_volume: return (854ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" acquired by "delete_volume" :: waited 0.156s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde20448-5750-420d-a724-138d50629e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3816bb5-7996-4029-bed0-63ced3eabc7e', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e78bf28-5214-477b-99cd-d3cf06ed82d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e83df-da3d-472f-b08f-6255d6f8a444]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Volume volume-d3816bb5-7996-4029-bed0-63ced3eabc7e (d3816bb5-7996-4029-bed0-63ced3eabc7e): created successfully
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e78bf28-5214-477b-99cd-d3cf06ed82d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Flow 'volume_create_manager' (8f3410cc-3164-4dfb-af4d-36e2bf60b61b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-698b3738-2e33-4708-8896-25324b1eac4a req-50d48140-1527-4189-8ac7-b67b453382b7 tempest-VolumesGetTestJSON-698427361 None] Created volume successfully.
Sep 10 19:36:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" returned: 0 in 0.611s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" returned: 0 in 0.109s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:43 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-fc714cdf-5083-46d7-bf67-ad1c41f0ddab" released by "delete_volume" :: held 0.897s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:43 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['a9a03793-891a-4eed-9c55-6a1d2acfde97', '49e54de0-081c-4506-bc68-c55dfbed7194', 'c77d97c2-17f0-4700-a7b5-4042ea2a5963', '3c1452ef-ff52-41e2-8ee4-8a6dad403347'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Acquiring lock "cinder-d3816bb5-7996-4029-bed0-63ced3eabc7e-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.189s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "cinder-d3816bb5-7996-4029-bed0-63ced3eabc7e-delete_volume" acquired by "delete_volume" :: waited 0.709s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-21085e00-1409-421b-b89a-ce5b6e304718-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:44 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-21085e00-1409-421b-b89a-ce5b6e304718-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Acquiring lock "cinder-quobyte-d3816bb5-7996-4029-bed0-63ced3eabc7e" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-21085e00-1409-421b-b89a-ce5b6e304718" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2d00c6cb-73fb-4ad4-b123-7e699042ea7f tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-fc714cdf-5083-46d7-bf67-ad1c41f0ddab-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "cinder-quobyte-d3816bb5-7996-4029-bed0-63ced3eabc7e" acquired by "delete_volume" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-21085e00-1409-421b-b89a-ce5b6e304718" acquired by "delete_volume" :: waited 0.044s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb239040-5e63-433b-b996-f14aeee80e84]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ed2b2-7054-4195-ab0f-e413bbda6514]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e" returned: 0 in 0.560s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:45 devstack quobyte-client[82905]: System call of process 96623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718" returned: 0 in 0.585s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d3816bb5-7996-4029-bed0-63ced3eabc7e" returned: 0 in 0.200s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "cinder-quobyte-d3816bb5-7996-4029-bed0-63ced3eabc7e" released by "delete_volume" :: held 0.955s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-21085e00-1409-421b-b89a-ce5b6e304718" returned: 0 in 0.348s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-21085e00-1409-421b-b89a-ce5b6e304718" released by "delete_volume" :: held 1.165s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.quota [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Created reservations ['f754191d-9ed3-4eec-b37f-b207b330e3b8', 'c63282f6-61f3-4656-9849-b80237dace1c', '9d638a7c-61fc-4c8e-a407-65943a73b0ba', '749616e0-ab0d-49f8-9559-d3c39b68092a'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['8ce65f56-dd43-47ca-a564-ea206d788e97', '56e09b81-6407-44e4-8532-e4c1b5bda9b3', 'cec889ef-e2ac-4f97-8b5c-cadf67cde3d0', '4cd4e8da-a0ab-4354-a0c6-a72f781217d5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.174s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:46 devstack cinder-volume[82863]: DEBUG cinder.manager [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:46 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Deleted volume successfully.
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-dbd3f044-3bb7-492c-b9d0-d674056ea5c5 req-695ca23f-c8a9-4f6c-a57f-c50b74aca458 tempest-VolumesGetTestJSON-698427361 None] Lock "cinder-d3816bb5-7996-4029-bed0-63ced3eabc7e-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.291s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b-delete_volume" acquired by "delete_volume" :: waited 0.117s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d9a3b878-abb7-4a41-aae8-a09ac3d4544a tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-21085e00-1409-421b-b89a-ce5b6e304718-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" acquired by "delete_volume" :: waited 0.021s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d2d99d-453c-4d58-8ecd-6cbe8dade1e5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" returned: 0 in 0.522s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" returned: 0 in 0.131s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b" released by "delete_volume" :: held 0.850s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['f76e7bab-255a-4d0d-b9d8-a0c49feaad80', 'dabe9191-0754-4eca-b34a-68a45032277d', '64deeb03-bc3d-454f-8305-3dd8c9d9d42b', '0b031d9e-a7a9-4aa4-b68d-1489cba13318'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.102s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f85095ea-d804-4990-913a-a6fdc166b1b5 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-d523301c-08ec-4c65-ad9c-d4eb0ac7f19b-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-2e791c2b-71e1-4d24-8b27-2dd4eb114154-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-2e791c2b-71e1-4d24-8b27-2dd4eb114154-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-2e791c2b-71e1-4d24-8b27-2dd4eb114154" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-2e791c2b-71e1-4d24-8b27-2dd4eb114154" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7d0f7b-a3f2-4b17-8dec-cfc8236abf0c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154" returned: 0 in 0.486s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2e791c2b-71e1-4d24-8b27-2dd4eb114154" returned: 0 in 0.151s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-2e791c2b-71e1-4d24-8b27-2dd4eb114154" released by "delete_volume" :: held 0.823s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['781b4185-97f9-4446-8f4f-3befc73a8801', '7bb2f8b6-81c7-4a86-ba60-fc79b6d53d69', '5c289847-03f6-4472-bc02-919a997b3af5', '40dcfbf9-1baa-4b0e-a359-4122e2799fd0'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.107s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73f6f1dc-5d4e-4387-9152-ac9f900c1682 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-2e791c2b-71e1-4d24-8b27-2dd4eb114154-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (0510c72d-8633-4a8a-9121-640dee87797d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1492c3-0201-459b-954e-5f180be5ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1492c3-0201-459b-954e-5f180be5ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2093599486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa7daef-a305-437f-83d5-07e2a77df232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:52Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6463b9c9-be67-49b0-878d-8c7d6cd1e965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6463b9c9-be67-49b0-878d-8c7d6cd1e965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb2abd-97be-440b-bcf3-af8a8dc8f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bb2abd-97be-440b-bcf3-af8a8dc8f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa7daef-a305-437f-83d5-07e2a77df232', 'volume_name': 'volume-3fa7daef-a305-437f-83d5-07e2a77df232', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530645dc-c485-458e-8062-fd00c3ee6f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530645dc-c485-458e-8062-fd00c3ee6f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493e6d84-b933-4350-85df-9f36915f5d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:52 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Volume 3fa7daef-a305-437f-83d5-07e2a77df232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa7daef-a305-437f-83d5-07e2a77df232', 'volume_size': 1}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2093599486',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa7daef-a305-437f-83d5-07e2a77df232,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:52Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Creating volume 3fa7daef-a305-437f-83d5-07e2a77df232 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:52 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:52 devstack quobyte-client[82905]: System call of process 96649 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:52 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=102, name=volume-3fa7daef-a305-437f-83d5-07e2a77df232, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232 1073741824" returned: 0 in 0.471s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232" returned: 0 in 0.352s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] <== create_volume: return (862ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493e6d84-b933-4350-85df-9f36915f5d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa7daef-a305-437f-83d5-07e2a77df232', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27831fcd-1f19-49b8-a196-ade7ecac2854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea97bd1c-f07c-4e49-a60b-0d980873ba4d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:53 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Volume volume-3fa7daef-a305-437f-83d5-07e2a77df232 (3fa7daef-a305-437f-83d5-07e2a77df232): created successfully
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27831fcd-1f19-49b8-a196-ade7ecac2854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (0510c72d-8633-4a8a-9121-640dee87797d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5e39891b-5ca3-4324-af0a-5140ff15e914 tempest-VolumesTestJSON-1002108208 None] Created volume successfully.
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" returned: 0 in 0.549s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b" released by "delete_volume" :: held 0.893s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['c49e393f-0511-45b2-9cce-3efe5120f453', 'ff9efc0e-f7bd-497a-92f8-f466130b4f0a', '632f2ed9-f929-4c59-8ddd-a42fb15ac841', 'da53daaf-a4f8-4316-bfb1-b3cb8ac0e6e9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.157s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-d49fcda6-689b-48aa-a412-836d34d8ddc3-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-d49fcda6-689b-48aa-a412-836d34d8ddc3-delete_volume" acquired by "delete_volume" :: waited 0.202s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9d296837-b99e-4e55-8b85-205dcc1f8bce tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-f2fdb74b-11a7-4e42-bea5-9165aeb41b7b-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:54 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (067202de-57ed-4499-9250-07094e92da56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017caef-f0ed-4c3d-85b3-bcd6fb9749af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7017caef-f0ed-4c3d-85b3-bcd6fb9749af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397224012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baff6625-322a-4516-8626-65ee01f9920f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:55Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83d929-96e9-4e25-873e-ae490581895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83d929-96e9-4e25-873e-ae490581895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c18dce9-2162-4a3f-b928-a73e1b8c1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c18dce9-2162-4a3f-b928-a73e1b8c1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baff6625-322a-4516-8626-65ee01f9920f', 'volume_name': 'volume-baff6625-322a-4516-8626-65ee01f9920f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f41e2e-95f8-45f1-b9f8-58e9a8370b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23f41e2e-95f8-45f1-b9f8-58e9a8370b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87388223-03e6-4926-8396-30e34f8b9a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:55 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Volume baff6625-322a-4516-8626-65ee01f9920f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baff6625-322a-4516-8626-65ee01f9920f', 'volume_size': 1}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397224012',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baff6625-322a-4516-8626-65ee01f9920f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:55Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Creating volume baff6625-322a-4516-8626-65ee01f9920f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:55 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "cinder-quobyte-d49fcda6-689b-48aa-a412-836d34d8ddc3" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:36:55 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=103, name=volume-baff6625-322a-4516-8626-65ee01f9920f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-d49fcda6-689b-48aa-a412-836d34d8ddc3" acquired by "delete_volume" :: waited 0.104s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d433bcf-7ad0-41ce-a83a-2fcd2dd30f51]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f 1073741824" returned: 0 in 0.580s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f" returned: 0 in 0.113s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] <== create_volume: return (797ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87388223-03e6-4926-8396-30e34f8b9a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baff6625-322a-4516-8626-65ee01f9920f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06546ff7-85bb-42b2-a0eb-a60bc2f8bd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3" returned: 0 in 0.783s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:56 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Volume volume-baff6625-322a-4516-8626-65ee01f9920f (baff6625-322a-4516-8626-65ee01f9920f): created successfully
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06546ff7-85bb-42b2-a0eb-a60bc2f8bd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (067202de-57ed-4499-9250-07094e92da56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-d49fcda6-689b-48aa-a412-836d34d8ddc3" returned: 0 in 0.303s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-quobyte-d49fcda6-689b-48aa-a412-836d34d8ddc3" released by "delete_volume" :: held 1.186s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-efde94e6-4f72-491e-aa8d-458e46afc205 tempest-VolumesTestJSON-1002108208 None] Created volume successfully.
Sep 10 19:36:56 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Created reservations ['e47de395-05a9-4cc0-a798-4a3a0d69d73e', '9bd58ea6-413e-4399-b1f5-9e4d5e0f4c4b', '9d8f1e1f-5279-4cf5-b788-3eac3df96417', '573d100d-2ad5-48c8-ac8f-f60f072e90ed'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.111s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:36:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Deleted volume successfully.
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b8ffe566-d54c-46b7-bac1-4b7c8fb51a41 tempest-CreateVolumesFromSourceVolumeTest-95178968 None] Lock "cinder-d49fcda6-689b-48aa-a412-836d34d8ddc3-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:36:57 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:36:57 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (b7dce18e-8017-4d28-b539-772a37721bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d1f078-f946-4cf4-917b-a368808d6064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d1f078-f946-4cf4-917b-a368808d6064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-278915180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7345eb9a-03c6-49ea-9300-2a1cc2d52bb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:58Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852853c-2d8c-4f13-b74f-8a798b29af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e852853c-2d8c-4f13-b74f-8a798b29af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea61eb9-ccdb-4e70-8e8f-3e5187d41a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea61eb9-ccdb-4e70-8e8f-3e5187d41a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7345eb9a-03c6-49ea-9300-2a1cc2d52bb1', 'volume_name': 'volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b37f177-3d6b-484b-b643-9b528ae6fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b37f177-3d6b-484b-b643-9b528ae6fd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce810e0-2172-445f-ac06-2668817b8a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:58 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Volume 7345eb9a-03c6-49ea-9300-2a1cc2d52bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1', 'volume_size': 1}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-278915180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7345eb9a-03c6-49ea-9300-2a1cc2d52bb1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d6c207e3937a4fee98c87b99c5555fb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:36:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:36:58Z,use_quota=True,user_id='c7a3b242189f4fe4b4e65b2dd0e1b4ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Creating volume 7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:36:58 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:58 devstack quobyte-client[82905]: System call of process 96668 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:36:58 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=104, name=volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 1073741824" returned: 0 in 0.420s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" returned: 0 in 0.144s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:36:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:36:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce810e0-2172-445f-ac06-2668817b8a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d025ddd2-d4bf-4baf-8eae-cdcf1cb84e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:36:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Volume volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 (7345eb9a-03c6-49ea-9300-2a1cc2d52bb1): created successfully
Sep 10 19:36:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d025ddd2-d4bf-4baf-8eae-cdcf1cb84e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:36:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Flow 'volume_create_manager' (b7dce18e-8017-4d28-b539-772a37721bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:36:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-04ae50b2-e8b5-4160-a8ca-32ea5350bbae tempest-VolumesTestJSON-1002108208 None] Created volume successfully.
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "cinder-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-quobyte-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" acquired by "delete_volume" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8c895-6d84-42e7-a7c1-3a6a995d7c9e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" returned: 0 in 0.522s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" returned: 0 in 0.126s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1" released by "delete_volume" :: held 0.855s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:02 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Created reservations ['7ebd67e3-ff9c-411c-bb40-231c800ee472', '301db9da-084e-433a-9576-26444d899c6f', '0beabc19-c805-4889-868e-5ea2d4f42210', '5b79fe0b-a784-401f-9965-b5170b99da15'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Flow 'volume_create_manager' (b29b8313-7173-4911-b46b-81885d5e6aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47abaaa8-0571-4808-9afa-710028f54e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47abaaa8-0571-4808-9afa-710028f54e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b64f1-3153-4793-b628-510244f10e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723194777f1404b8313b861f8ab5410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:03Z,use_quota=True,user_id='77ce8715534f4c31a962f98011082085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bed0b5-6938-4fd6-ae30-f0e851639c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bed0b5-6938-4fd6-ae30-f0e851639c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe20c7-a938-426d-9b39-9242c08a2bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fe20c7-a938-426d-9b39-9242c08a2bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93b64f1-3153-4793-b628-510244f10e9c', 'volume_name': 'volume-b93b64f1-3153-4793-b628-510244f10e9c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb841d1f-e21f-4130-978f-5cd6568fb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb841d1f-e21f-4130-978f-5cd6568fb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad64f32-7705-40ab-b213-2ba59a61d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:03 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Volume b93b64f1-3153-4793-b628-510244f10e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93b64f1-3153-4793-b628-510244f10e9c', 'volume_size': 1}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b64f1-3153-4793-b628-510244f10e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723194777f1404b8313b861f8ab5410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:03Z,use_quota=True,user_id='77ce8715534f4c31a962f98011082085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Creating volume b93b64f1-3153-4793-b628-510244f10e9c {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:03 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:03 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=105, name=volume-b93b64f1-3153-4793-b628-510244f10e9c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c 1073741824" returned: 0 in 0.603s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-baff6625-322a-4516-8626-65ee01f9920f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c" returned: 0 in 0.303s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] <== create_volume: return (974ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.551s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad64f32-7705-40ab-b213-2ba59a61d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93b64f1-3153-4793-b628-510244f10e9c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1155cdb0-6c9e-4be6-907f-3a75a27e1c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "cinder-baff6625-322a-4516-8626-65ee01f9920f-delete_volume" acquired by "delete_volume" :: waited 0.274s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Deleted volume successfully.
Sep 10 19:37:04 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Volume volume-b93b64f1-3153-4793-b628-510244f10e9c (b93b64f1-3153-4793-b628-510244f10e9c): created successfully
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1155cdb0-6c9e-4be6-907f-3a75a27e1c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Flow 'volume_create_manager' (b29b8313-7173-4911-b46b-81885d5e6aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-94fc7401-22f0-4c1c-8628-b48bff0f1b05 tempest-CinderUnicodeTest-1269666354 None] Created volume successfully.
Sep 10 19:37:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-quobyte-baff6625-322a-4516-8626-65ee01f9920f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a2d1e30-6de4-461c-b251-e9f169ed9069 tempest-VolumesTestJSON-1002108208 None] Lock "cinder-7345eb9a-03c6-49ea-9300-2a1cc2d52bb1-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-baff6625-322a-4516-8626-65ee01f9920f" acquired by "delete_volume" :: waited 0.026s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ed6d8-7a52-4850-ad9f-a57e90174b0b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f" returned: 0 in 0.476s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-baff6625-322a-4516-8626-65ee01f9920f" returned: 0 in 0.160s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-baff6625-322a-4516-8626-65ee01f9920f" released by "delete_volume" :: held 0.928s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Created reservations ['9833b7aa-c9bf-46b1-8b6c-dc2f43db934e', '61b73316-91c7-4a1a-9f8e-16e82203b14d', '4b731659-2ddd-4180-8843-e0564ca65cee', '823ca7c6-eccf-4f29-a378-ee5e4cadcba9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Flow 'volume_create_manager' (b4da5973-a496-45c4-92df-1c101593f714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fdb2e5-1a63-4e09-b6c6-713e6775677c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2fdb2e5-1a63-4e09-b6c6-713e6775677c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774083024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49043f-be59-4445-a8aa-c8f152f566e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723194777f1404b8313b861f8ab5410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:06Z,use_quota=True,user_id='77ce8715534f4c31a962f98011082085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bd1a0f-4c89-4d73-94ef-4385931f50a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bd1a0f-4c89-4d73-94ef-4385931f50a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c03547a-321b-4375-8848-74bd03499685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c03547a-321b-4375-8848-74bd03499685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b49043f-be59-4445-a8aa-c8f152f566e7', 'volume_name': 'volume-9b49043f-be59-4445-a8aa-c8f152f566e7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fa917b-eb9c-469d-91ae-0c15e007d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fa917b-eb9c-469d-91ae-0c15e007d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5984a6c-4fbc-4a03-9d09-5f0c604f6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:06 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Volume 9b49043f-be59-4445-a8aa-c8f152f566e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b49043f-be59-4445-a8aa-c8f152f566e7', 'volume_size': 1}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1774083024',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b49043f-be59-4445-a8aa-c8f152f566e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e723194777f1404b8313b861f8ab5410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:06Z,use_quota=True,user_id='77ce8715534f4c31a962f98011082085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Creating volume 9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:06 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-3fa7daef-a305-437f-83d5-07e2a77df232-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:06 devstack quobyte-client[82905]: System call of process 96688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:06 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=106, name=volume-9b49043f-be59-4445-a8aa-c8f152f566e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.815s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "cinder-3fa7daef-a305-437f-83d5-07e2a77df232-delete_volume" acquired by "delete_volume" :: waited 0.217s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Deleted volume successfully.
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 1073741824" returned: 0 in 0.533s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:07 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Acquiring lock "cinder-quobyte-3fa7daef-a305-437f-83d5-07e2a77df232" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7" returned: 0 in 0.404s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-18db5a2e-685e-4c7a-9963-28a0090089db tempest-VolumesTestJSON-1002108208 None] Lock "cinder-baff6625-322a-4516-8626-65ee01f9920f-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] <== create_volume: return (977ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-3fa7daef-a305-437f-83d5-07e2a77df232" acquired by "delete_volume" :: waited 0.084s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5984a6c-4fbc-4a03-9d09-5f0c604f6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b49043f-be59-4445-a8aa-c8f152f566e7', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c794a8c0-0ce7-4b32-bfb6-e5ab26980f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbab723e-8708-464a-8d51-9deb1a7ad225]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:07 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Volume volume-9b49043f-be59-4445-a8aa-c8f152f566e7 (9b49043f-be59-4445-a8aa-c8f152f566e7): created successfully
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c794a8c0-0ce7-4b32-bfb6-e5ab26980f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Flow 'volume_create_manager' (b4da5973-a496-45c4-92df-1c101593f714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-81f718fa-8628-4983-877f-41ac1a6b6923 tempest-CinderUnicodeTest-1269666354 None] Created volume successfully.
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232" returned: 0 in 0.675s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-3fa7daef-a305-437f-83d5-07e2a77df232" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "cinder-quobyte-3fa7daef-a305-437f-83d5-07e2a77df232" released by "delete_volume" :: held 0.969s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Creating offline snapshot 5a2ba3bf-b89d-4645-89ee-9c3361831562 of volume 9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Created reservations ['f6bd41ba-81f1-4801-9e68-a0fb8903ee29', '7ec5bbc5-ffc6-436d-b418-0f819ae8b702', 'adbe7bad-6a3d-492f-88c8-b6e0107a096a', 'b4e57d33-7d4f-4eee-b8b5-37e848b7cf36'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[84469396-9a5f-4627-80cd-f23a4f9a8e76]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7" returned: 0 in 0.612s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.278s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:09 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Deleted volume successfully.
Sep 10 19:37:09 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=107, name=volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4d31f7e5-0a5a-4a80-a719-0cc383a3387a tempest-VolumesTestJSON-1002108208 None] Lock "cinder-3fa7daef-a305-437f-83d5-07e2a77df232-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 1G" returned: 0 in 0.472s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9b49043f-be59-4445-a8aa-c8f152f566e7 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:10 devstack quobyte-client[82905]: System call of process 96703 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "qemu-img rebase -u -b volume-9b49043f-be59-4445-a8aa-c8f152f566e7 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.179s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.121s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.110s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.info" returned: 0 in 0.134s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.info" returned: 0 in 0.119s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:11 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7adc06aa-dda4-4551-aa13-30fc4d28c3ce tempest-CinderUnicodeTest-1269666354 None] Create snapshot completed successfully
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-5a2ba3bf-b89d-4645-89ee-9c3361831562-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-5a2ba3bf-b89d-4645-89ee-9c3361831562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-quobyte-5a2ba3bf-b89d-4645-89ee-9c3361831562" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-5a2ba3bf-b89d-4645-89ee-9c3361831562" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Deleting offline snapshot 5a2ba3bf-b89d-4645-89ee-9c3361831562 of volume 9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] snapshot_file for this snap is: volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c437f-10da-43fc-93cf-f0f60127575c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.460s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b49043f-be59-4445-a8aa-c8f152f566e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3fec2-65dc-4595-89eb-11728835653b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7" returned: 0 in 0.551s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.234s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7.5a2ba3bf-b89d-4645-89ee-9c3361831562" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-5a2ba3bf-b89d-4645-89ee-9c3361831562" released by "_delete_snapshot" :: held 1.719s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" released by "delete_snapshot" :: held 1.756s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:14 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Created reservations ['75c86f5e-8395-4523-b5a4-7768bcda88ed', '4240cc8d-105d-4305-8e4a-a94f505aa613', '8fece5cc-7e07-4de5-a7fc-ccd242dc3d7b', '933b3fae-2be8-47be-9e21-5658264a0e54'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Delete snapshot completed successfully.
Sep 10 19:37:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-970ef3b0-961a-4909-a6ff-ef3b171213a2 tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-5a2ba3bf-b89d-4645-89ee-9c3361831562-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:14 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-57156c6a-5c1f-4545-acd4-44e2ac6d40bd tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-57156c6a-5c1f-4545-acd4-44e2ac6d40bd tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-1943164380: creating
Sep 10 19:37:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-57156c6a-5c1f-4545-acd4-44e2ac6d40bd tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-1943164380: created successfully
Sep 10 19:37:14 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-57156c6a-5c1f-4545-acd4-44e2ac6d40bd tempest-GroupSnapshotsTest-1047407689 None] Create group completed successfully.
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-9b49043f-be59-4445-a8aa-c8f152f566e7-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-9b49043f-be59-4445-a8aa-c8f152f566e7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f3efc5-77e3-47c6-9794-3541f2a3803a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7" returned: 0 in 0.418s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9b49043f-be59-4445-a8aa-c8f152f566e7" returned: 0 in 0.144s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-9b49043f-be59-4445-a8aa-c8f152f566e7" released by "delete_volume" :: held 0.738s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Created reservations ['1a278578-7f2a-4b90-8357-5e1e9948bb97', '743c4634-9593-4c58-b3f8-ccd13ae1cfae', '0415ce04-cb80-486f-84d6-b5c92989c450', '7c4e6232-4e43-42b4-8f44-c981b0faa2a5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.349s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:17 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (ab28aef4-22f2-4cb9-a079-06e8d27772a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c415e6d2-a111-4c15-905f-1f8221feef6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Deleted volume successfully.
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c415e6d2-a111-4c15-905f-1f8221feef6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164311840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=90988578-4e8e-4921-8777-4436acf2326e,host='devstack@QuobyteHD#QuobyteHD',id=5cccc2bb-d288-45c2-b2f0-53420486289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:17Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9e3d03-25d0-43b3-8e0d-43cdd59eef94),volume_type_id=3f9e3d03-25d0-43b3-8e0d-43cdd59eef94)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc82f10e-a2fa-4fab-9191-93cea5d1ee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc82f10e-a2fa-4fab-9191-93cea5d1ee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97b5dfb-25bd-4cfa-acad-5f59e2ba60e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d97b5dfb-25bd-4cfa-acad-5f59e2ba60e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cccc2bb-d288-45c2-b2f0-53420486289c', 'volume_name': 'volume-5cccc2bb-d288-45c2-b2f0-53420486289c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4f07c3-d231-44bf-8656-2fff02d6f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4f07c3-d231-44bf-8656-2fff02d6f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da38199f-a7fd-4a67-8a9f-0bd186b77f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Volume 5cccc2bb-d288-45c2-b2f0-53420486289c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cccc2bb-d288-45c2-b2f0-53420486289c', 'volume_size': 1}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=90988578-4e8e-4921-8777-4436acf2326e,created_at=2025-09-10T17:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-164311840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=90988578-4e8e-4921-8777-4436acf2326e,host='devstack@QuobyteHD#QuobyteHD',id=5cccc2bb-d288-45c2-b2f0-53420486289c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:17Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f9e3d03-25d0-43b3-8e0d-43cdd59eef94),volume_type_id=3f9e3d03-25d0-43b3-8e0d-43cdd59eef94)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Creating volume 5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:17 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:17 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=109, name=volume-5cccc2bb-d288-45c2-b2f0-53420486289c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98c113a6-2af4-4294-83dd-560e14f57f3c tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-9b49043f-be59-4445-a8aa-c8f152f566e7-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-b93b64f1-3153-4793-b628-510244f10e9c-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-b93b64f1-3153-4793-b628-510244f10e9c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c 1073741824" returned: 0 in 0.582s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.260s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] <== create_volume: return (881ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da38199f-a7fd-4a67-8a9f-0bd186b77f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cccc2bb-d288-45c2-b2f0-53420486289c', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9730dc-9ac9-4a3e-8438-8058988bda75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "cinder-quobyte-b93b64f1-3153-4793-b628-510244f10e9c" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:18 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Volume volume-5cccc2bb-d288-45c2-b2f0-53420486289c (5cccc2bb-d288-45c2-b2f0-53420486289c): created successfully
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9730dc-9ac9-4a3e-8438-8058988bda75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (ab28aef4-22f2-4cb9-a079-06e8d27772a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-b93b64f1-3153-4793-b628-510244f10e9c" acquired by "delete_volume" :: waited 0.076s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d1cab-5a89-4161-8842-163126c6ea9a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c16c07ef-524d-484d-b4da-0b4a5c7d9a26 tempest-GroupSnapshotsTest-1047407689 None] Created volume successfully.
Sep 10 19:37:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c" returned: 0 in 0.495s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b93b64f1-3153-4793-b628-510244f10e9c" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-quobyte-b93b64f1-3153-4793-b628-510244f10e9c" released by "delete_volume" :: held 0.826s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:19 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] GroupSnapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: creating.
Sep 10 19:37:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Group snapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: creating. {{(pid=82863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Creating offline snapshot 9abb5f96-e7f2-4714-bada-6f1d28cb4e7b of volume 5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fad3b2-2f59-461d-915e-256bf1be2e54]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:19 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Created reservations ['d13e15c3-f491-4d22-9b8b-24490ec88d39', '93941aa6-1f7d-49e7-ba43-12ed675cc841', '86a32f3c-173f-468d-9491-14294ed79126', '5e5b58ea-a106-42b5-99f6-4504e749efd9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.578s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:20 devstack quobyte-client[82905]: System call of process 96737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=110, name=volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b 1G" returned: 0 in 0.407s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5cccc2bb-d288-45c2-b2f0-53420486289c -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:20 devstack quobyte-client[82905]: System call of process 96741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img rebase -u -b volume-5cccc2bb-d288-45c2-b2f0-53420486289c -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.265s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.189s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Deleted volume successfully.
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.342s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-625eef86-a322-493a-870c-88bd895812df tempest-CinderUnicodeTest-1269666354 None] Lock "cinder-b93b64f1-3153-4793-b628-510244f10e9c-delete_volume" released by "delete_volume" :: held 3.798s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.279s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.info" returned: 0 in 0.152s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.info" returned: 0 in 0.131s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:22 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:INSERT=29,cinder:UPDATE=153,cinder:SELECT=91,cinder:DELETE=14 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f9c0fe9c-18d9-4048-bca3-84c58e0714ac tempest-GroupSnapshotsTest-1047407689 None] group_snapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: created successfully
Sep 10 19:37:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b-5fd8e01c-d0c0-480f-8b79-87286dc09dae" by "_create_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b-5fd8e01c-d0c0-480f-8b79-87286dc09dae" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Creating volume 5fd8e01c-d0c0-480f-8b79-87286dc09dae from snapshot 9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" by "_copy_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] snapshot: 9abb5f96-e7f2-4714-bada-6f1d28cb4e7b, volume: 5fd8e01c-d0c0-480f-8b79-87286dc09dae,  {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[678eddf1-3e0c-42c8-a7fe-cedbd05a3b8e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.445s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cccc2bb-d288-45c2-b2f0-53420486289c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Creating direct copy from snapshot {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6961f19-d0c5-49a7-b99a-3851d15a12c6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.420s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG cinder.utils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae not found in is_blk_device check {{(pid=82863) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:37:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:25 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=112, name=volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae" returned: 0 in 6.867s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:32 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbefe862-c090-4206-9f8b-015813dd1df8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.564s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:37:33 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Converted 1024.00 MB image at 148.46 MB/s
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae" returned: 0 in 0.099s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" released by "_copy_volume_from_snapshot" :: held 8.862s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b-5fd8e01c-d0c0-480f-8b79-87286dc09dae" released by "_create_volume_from_snapshot" :: held 8.905s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.938s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:33 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=108,cinder:INSERT=33,cinder:UPDATE=151,cinder:DELETE=15 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:37:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c14d80da-8aaf-4275-a95c-0a7cb24e58d1 tempest-GroupSnapshotsTest-1047407689 None] Create group from source-snapshot-fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f completed successfully.
Sep 10 19:37:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" acquired by "delete_volume" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[36be448c-65ad-4e40-af03-8ec70e6011a6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:35 devstack quobyte-client[82905]: System call of process 96777 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae" returned: 0 in 0.538s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5fd8e01c-d0c0-480f-8b79-87286dc09dae" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5fd8e01c-d0c0-480f-8b79-87286dc09dae" released by "delete_volume" :: held 0.884s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:36 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['2b62945d-54a8-4943-80eb-50c3947b4be9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:36 devstack cinder-volume[82863]: WARNING cinder.quota [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1126334755 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1126334755, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:37:36 devstack cinder-volume[82863]: WARNING cinder.quota [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1126334755 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1126334755, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:37:36 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['d8fd84a0-5a4f-436a-8d6b-e526c1bfc05d', '86eb6164-4584-4472-bd02-94e6c5d1df2c', 'f9c6c3e1-cec7-4345-b6e5-d136ae941e2e', '552b1dda-b0d6-4848-b8a5-0c82f0325c2f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.236s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.164s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-37ab1d48-05ea-4a42-84c8-add35e277393 tempest-GroupSnapshotsTest-1047407689 None] Delete group completed successfully.
Sep 10 19:37:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: deleting
Sep 10 19:37:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: deleting {{(pid=82863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Deleting offline snapshot 9abb5f96-e7f2-4714-bada-6f1d28cb4e7b of volume 5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] snapshot_file for this snap is: volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bfa8e0-f696-44a6-b352-c870b1990783]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.411s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cccc2bb-d288-45c2-b2f0-53420486289c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a66c30-d675-494b-83b6-f528d04b8c51]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.411s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:39 devstack quobyte-client[82905]: System call of process 96815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.203s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c.9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" returned: 0 in 0.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-9abb5f96-e7f2-4714-bada-6f1d28cb4e7b" released by "_delete_snapshot" :: held 1.438s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" released by "delete_snapshot" :: held 1.480s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:40 devstack cinder-volume[82863]: WARNING cinder.quota [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1126334755 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1126334755, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:37:40 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['7431ce3e-3262-4378-b831-2a4c35976fc3', 'e23bc47d-1f6f-401b-a9c8-6d84045963ea', 'd14afe41-3333-4525-9ff8-830ea12daaab', '791367e8-3370-48b0-9d17-6f7533d9d8db'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f4c9e304-8d0f-4062-a17f-a49209f85857 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot fa3d9f51-696c-4f78-9a3c-3ac80a30cd5f: deleted successfully
Sep 10 19:37:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" acquired by "delete_volume" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b072b7-ff5f-40c9-8a4a-5762c1e93235]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.422s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5cccc2bb-d288-45c2-b2f0-53420486289c" returned: 0 in 0.109s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:42 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-5cccc2bb-d288-45c2-b2f0-53420486289c" released by "delete_volume" :: held 0.703s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['067f6e59-199a-431a-b69a-b471eaed7725'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:43 devstack cinder-volume[82863]: WARNING cinder.db.sqlalchemy.api [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1126334755']
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['36a82ade-16f3-4b2f-b565-b143d0da0209', '3756b88d-7044-4264-8364-58cd77a7d8b1', '7ee5592e-1608-498d-9b83-fb25d970506c', 'f17f2193-4c46-40ee-81c4-783be7b1c032'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:43 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:37:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7e948040-4740-4aae-9561-ef171bf0b69d tempest-GroupSnapshotsTest-1047407689 None] Delete group completed successfully.
Sep 10 19:37:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-225b776d-44b9-41bc-8f07-335cc3c2e38a tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-225b776d-44b9-41bc-8f07-335cc3c2e38a tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-1601626425: creating
Sep 10 19:37:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-225b776d-44b9-41bc-8f07-335cc3c2e38a tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-1601626425: created successfully
Sep 10 19:37:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-225b776d-44b9-41bc-8f07-335cc3c2e38a tempest-GroupSnapshotsTest-1047407689 None] Create group completed successfully.
Sep 10 19:37:46 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:46 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (7af37009-1c88-4f21-ab88-6dfe2b91b401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b13e8c-a8b5-4fb0-9395-0a091b5835ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3b13e8c-a8b5-4fb0-9395-0a091b5835ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295490930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,host='devstack@QuobyteHD#QuobyteHD',id=a5c10c47-026a-4a29-8abd-f1bc06621dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:47Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66e7f4f-08f6-4f27-b42c-40d0e22d518e),volume_type_id=d66e7f4f-08f6-4f27-b42c-40d0e22d518e)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b773adf-5dd4-47b4-b219-18b66b852d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b773adf-5dd4-47b4-b219-18b66b852d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5559ed-d933-42a8-9e3d-d62bfa97a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5559ed-d933-42a8-9e3d-d62bfa97a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c10c47-026a-4a29-8abd-f1bc06621dae', 'volume_name': 'volume-a5c10c47-026a-4a29-8abd-f1bc06621dae', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2ece85-8043-431c-97b3-e0bfcc7626c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2ece85-8043-431c-97b3-e0bfcc7626c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450aadf6-3fa7-42c2-8c71-551ceda7b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:47 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Volume a5c10c47-026a-4a29-8abd-f1bc06621dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c10c47-026a-4a29-8abd-f1bc06621dae', 'volume_size': 1}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,created_at=2025-09-10T17:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1295490930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,host='devstack@QuobyteHD#QuobyteHD',id=a5c10c47-026a-4a29-8abd-f1bc06621dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:47Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66e7f4f-08f6-4f27-b42c-40d0e22d518e),volume_type_id=d66e7f4f-08f6-4f27-b42c-40d0e22d518e)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Creating volume a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:47 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:47 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=113, name=volume-a5c10c47-026a-4a29-8abd-f1bc06621dae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae 1073741824" returned: 0 in 0.392s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae" returned: 0 in 0.086s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] <== create_volume: return (543ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450aadf6-3fa7-42c2-8c71-551ceda7b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c10c47-026a-4a29-8abd-f1bc06621dae', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52fc923-e677-4a3d-b429-8e9f7bb8160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:48 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Volume volume-a5c10c47-026a-4a29-8abd-f1bc06621dae (a5c10c47-026a-4a29-8abd-f1bc06621dae): created successfully
Sep 10 19:37:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52fc923-e677-4a3d-b429-8e9f7bb8160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (7af37009-1c88-4f21-ab88-6dfe2b91b401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d03b5b02-304c-4cbd-a527-7858df9ce82c tempest-GroupSnapshotsTest-1047407689 None] Created volume successfully.
Sep 10 19:37:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:49 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:37:49 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (1fb614f1-0f53-4254-b20d-927ca26a350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:49 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e74b209-cf64-4ecc-8e38-e8d00702c7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:49 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e74b209-cf64-4ecc-8e38-e8d00702c7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1533622565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,host='devstack@QuobyteHD#QuobyteHD',id=6157f4eb-e5b3-4eb5-86f4-45e3586c0939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:50Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66e7f4f-08f6-4f27-b42c-40d0e22d518e),volume_type_id=d66e7f4f-08f6-4f27-b42c-40d0e22d518e)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:49 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068cbcbd-ab7d-4ae3-bc35-f8f047e23ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068cbcbd-ab7d-4ae3-bc35-f8f047e23ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40f6a70-5823-4e1e-9952-9064a3ea5cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40f6a70-5823-4e1e-9952-9064a3ea5cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6157f4eb-e5b3-4eb5-86f4-45e3586c0939', 'volume_name': 'volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231c198c-d06f-4f13-b1ce-2407cb0060f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (231c198c-d06f-4f13-b1ce-2407cb0060f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a4cbd1-e79e-4458-a1be-313399970f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:50 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Volume 6157f4eb-e5b3-4eb5-86f4-45e3586c0939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939', 'volume_size': 1}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,created_at=2025-09-10T17:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1533622565',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0b1ac7a5-3873-4bfe-a6d5-84bebfb2e7ec,host='devstack@QuobyteHD#QuobyteHD',id=6157f4eb-e5b3-4eb5-86f4-45e3586c0939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:37:50Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d66e7f4f-08f6-4f27-b42c-40d0e22d518e),volume_type_id=d66e7f4f-08f6-4f27-b42c-40d0e22d518e)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Creating volume 6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:37:50 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:50 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=114, name=volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 1073741824" returned: 0 in 0.389s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" returned: 0 in 0.127s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] <== create_volume: return (587ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.598s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a4cbd1-e79e-4458-a1be-313399970f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52789a0c-3a85-4f64-a2d1-feeda47017e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:37:50 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Volume volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 (6157f4eb-e5b3-4eb5-86f4-45e3586c0939): created successfully
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52789a0c-3a85-4f64-a2d1-feeda47017e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:37:50 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (1fb614f1-0f53-4254-b20d-927ca26a350c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:37:50 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-45721636-4ef5-4558-8920-bc42bcb4977f tempest-GroupSnapshotsTest-1047407689 None] Created volume successfully.
Sep 10 19:37:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c2c53e37-8996-4a72-97e9-cae2ef59af6a tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:52 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c2c53e37-8996-4a72-97e9-cae2ef59af6a tempest-GroupSnapshotsTest-1047407689 None] Update group completed successfully.
Sep 10 19:37:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d2edae32-ab66-48cc-afc4-3ac1f0524844 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d2edae32-ab66-48cc-afc4-3ac1f0524844 tempest-GroupSnapshotsTest-1047407689 None] Update group completed successfully.
Sep 10 19:37:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3ecefe47-f82e-44e6-9735-80a21e174113 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3ecefe47-f82e-44e6-9735-80a21e174113 tempest-GroupSnapshotsTest-1047407689 None] Update group completed successfully.
Sep 10 19:37:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e1df8559-62a6-4e0f-8616-a02ca40c3d6f tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:55 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e1df8559-62a6-4e0f-8616-a02ca40c3d6f tempest-GroupSnapshotsTest-1047407689 None] Update group completed successfully.
Sep 10 19:37:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] GroupSnapshot ad924b6f-6ac1-411c-986c-67f1e71688df: creating.
Sep 10 19:37:57 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Group snapshot ad924b6f-6ac1-411c-986c-67f1e71688df: creating. {{(pid=82863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Creating offline snapshot aa67842c-b346-4167-a975-c48bef1f7511 of volume a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cdb2a3-f4e6-43ce-abe4-e024593860bb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae" returned: 0 in 0.440s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=115, name=volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 1G" returned: 0 in 0.242s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a5c10c47-026a-4a29-8abd-f1bc06621dae -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img rebase -u -b volume-a5c10c47-026a-4a29-8abd-f1bc06621dae -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.info" returned: 0 in 0.109s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.info" returned: 0 in 0.085s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.526s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:37:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Creating offline snapshot dce1c63c-293d-46a9-bfe3-fbf56c31219a of volume 6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efeb180-cb9c-445a-8730-5434e3165b31]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" returned: 0 in 0.391s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:59 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=117, name=volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a 1G" returned: 0 in 0.263s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:37:59 devstack quobyte-client[82905]: System call of process 96861 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img rebase -u -b volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:37:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.081s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.info" returned: 0 in 0.122s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.info" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.629s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-58e18232-9558-45cd-a244-626e41a22d29 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot ad924b6f-6ac1-411c-986c-67f1e71688df: created successfully
Sep 10 19:38:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot ad924b6f-6ac1-411c-986c-67f1e71688df: deleting
Sep 10 19:38:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot ad924b6f-6ac1-411c-986c-67f1e71688df: deleting {{(pid=82863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:38:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" acquired by "delete_snapshot" :: waited 0.069s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-aa67842c-b346-4167-a975-c48bef1f7511" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-aa67842c-b346-4167-a975-c48bef1f7511" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Deleting offline snapshot aa67842c-b346-4167-a975-c48bef1f7511 of volume a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] snapshot_file for this snap is: volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e02faf7-0b7b-46a6-88a6-c4e6f4856c89]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.379s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c10c47-026a-4a29-8abd-f1bc06621dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918aa72-281e-4348-bd0f-d18a868863f7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae" returned: 0 in 0.445s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.268s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae.aa67842c-b346-4167-a975-c48bef1f7511" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-aa67842c-b346-4167-a975-c48bef1f7511" released by "_delete_snapshot" :: held 1.485s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" released by "delete_snapshot" :: held 1.522s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-dce1c63c-293d-46a9-bfe3-fbf56c31219a" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-dce1c63c-293d-46a9-bfe3-fbf56c31219a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Deleting offline snapshot dce1c63c-293d-46a9-bfe3-fbf56c31219a of volume 6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] snapshot_file for this snap is: volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60166a22-f3fc-484c-b462-ccc20d9387ea]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.406s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ace1a-ab36-4be8-bb9c-1d2d8d2c9841]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" returned: 0 in 0.396s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.204s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939.dce1c63c-293d-46a9-bfe3-fbf56c31219a" returned: 0 in 0.092s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-dce1c63c-293d-46a9-bfe3-fbf56c31219a" released by "_delete_snapshot" :: held 1.437s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" released by "delete_snapshot" :: held 1.462s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:05 devstack cinder-volume[82863]: WARNING cinder.quota [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1447160895 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1447160895, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:05 devstack cinder-volume[82863]: WARNING cinder.quota [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1447160895 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1447160895, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['fd06906f-9175-4264-82fa-a053150abd65', 'b6a17ad8-5cdd-4002-8882-6df6e0eaac3f', 'f853ebc4-c33c-4e07-8358-4c32354d8264', '82de85cf-7438-41d8-ab9d-1393ab2e41b1'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['6024bcd5-c619-4508-a6a8-45c61cf49180', 'bdd8ccbc-0c8a-49a0-9afb-db43daaa7632', '056c98d2-2298-436b-a356-eb2500652a6d', '4e9358b0-eb38-4934-a837-711c6f91c17b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-68f6416f-733c-49b9-bd5c-026742d155d0 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot ad924b6f-6ac1-411c-986c-67f1e71688df: deleted successfully
Sep 10 19:38:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" acquired by "delete_volume" :: waited 0.017s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:06 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed3b4f8-e6fe-40a1-bfd5-603553ca435a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" returned: 0 in 0.402s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" returned: 0 in 0.116s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-6157f4eb-e5b3-4eb5-86f4-45e3586c0939" released by "delete_volume" :: held 0.695s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" acquired by "delete_volume" :: waited 0.024s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3299dcb4-97fa-4acd-8508-3f5e690c6e31]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae" returned: 0 in 0.443s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a5c10c47-026a-4a29-8abd-f1bc06621dae" returned: 0 in 0.089s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-a5c10c47-026a-4a29-8abd-f1bc06621dae" released by "delete_volume" :: held 0.709s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['69aaecf1-d18b-480f-a106-37cca66a3c21'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:08 devstack cinder-volume[82863]: WARNING cinder.quota [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1447160895 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1447160895, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['f5f941c4-fc28-4297-a071-385c8e424bed', '8f2498e0-e447-412e-9799-aab183050c6c', '08bdde6d-09bc-4dfa-aa76-8421107ad0dd', 'fd1b9692-f6e0-4d77-8b7d-95e2d42f97ef'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['6e23549f-f89a-4525-af78-fe3996c102f7', '3fc07f30-834e-4b83-a05e-06a2eeedbff8', 'be8e691b-a6cd-4cba-a1e7-3ef3d8aca462', '35cccc20-54c8-4198-9e55-e6767fb4f127'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:09 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8a860673-7552-486e-bc32-305ce16e6fd6 tempest-GroupSnapshotsTest-1047407689 None] Delete group completed successfully.
Sep 10 19:38:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0374a8e8-c227-47be-a8d8-9f7462d79a2f tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0374a8e8-c227-47be-a8d8-9f7462d79a2f tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-797043542: creating
Sep 10 19:38:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0374a8e8-c227-47be-a8d8-9f7462d79a2f tempest-GroupSnapshotsTest-1047407689 None] Group tempest-GroupSnapshotsTest-Group-797043542: created successfully
Sep 10 19:38:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0374a8e8-c227-47be-a8d8-9f7462d79a2f tempest-GroupSnapshotsTest-1047407689 None] Create group completed successfully.
Sep 10 19:38:11 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (389c2c78-7eed-421d-b713-b73a4a42ddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053de194-2b78-4fe7-9400-97a7ba9aa265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053de194-2b78-4fe7-9400-97a7ba9aa265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468091387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=962b04e2-c3e6-43bd-bab8-97fe9485be26,host='devstack@QuobyteHD#QuobyteHD',id=ae7a1055-7eaa-466b-8128-3efdb8e861a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:11Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cae2f75-5e9c-49b9-9e4d-c10840fe9ca0),volume_type_id=3cae2f75-5e9c-49b9-9e4d-c10840fe9ca0)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696623b8-36df-4064-8ca2-f33df2707cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696623b8-36df-4064-8ca2-f33df2707cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0303eb-7223-45b7-81f9-507feb7d902c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0303eb-7223-45b7-81f9-507feb7d902c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7a1055-7eaa-466b-8128-3efdb8e861a0', 'volume_name': 'volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239da410-4235-4bd3-b68d-65b52bf8c31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (239da410-4235-4bd3-b68d-65b52bf8c31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4924aa1c-1304-4436-b7f0-85ba83890aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:11 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Volume ae7a1055-7eaa-466b-8128-3efdb8e861a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0', 'volume_size': 1}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=962b04e2-c3e6-43bd-bab8-97fe9485be26,created_at=2025-09-10T17:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1468091387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=962b04e2-c3e6-43bd-bab8-97fe9485be26,host='devstack@QuobyteHD#QuobyteHD',id=ae7a1055-7eaa-466b-8128-3efdb8e861a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ebdc0aaaeb445dab6b85fd96950958',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:11Z,use_quota=True,user_id='b6e12284e89e4ad0aea18dc7bcbbd912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cae2f75-5e9c-49b9-9e4d-c10840fe9ca0),volume_type_id=3cae2f75-5e9c-49b9-9e4d-c10840fe9ca0)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Creating volume ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:38:11 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:11 devstack quobyte-client[82905]: System call of process 96900 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:38:11 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=119, name=volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 1073741824" returned: 0 in 0.345s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0" returned: 0 in 0.084s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] <== create_volume: return (524ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4924aa1c-1304-4436-b7f0-85ba83890aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f364f32c-8310-49dc-a7ba-da15cc5b6f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:12 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Volume volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 (ae7a1055-7eaa-466b-8128-3efdb8e861a0): created successfully
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f364f32c-8310-49dc-a7ba-da15cc5b6f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Flow 'volume_create_manager' (389c2c78-7eed-421d-b713-b73a4a42ddfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:12 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7a680567-f5d7-442e-8c39-d2981e956d54 tempest-GroupSnapshotsTest-1047407689 None] Created volume successfully.
Sep 10 19:38:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] GroupSnapshot 19c47665-e565-45cd-a874-3f9f5167cc94: creating.
Sep 10 19:38:13 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Group snapshot 19c47665-e565-45cd-a874-3f9f5167cc94: creating. {{(pid=82863) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Creating offline snapshot 7b144d9c-7878-4927-b9bc-596c059ca74f of volume ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d2f96-6abb-4d77-8883-f121a9a3918c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0" returned: 0 in 0.465s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:13 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=120, name=volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:38:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f 1G" returned: 0 in 0.233s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack quobyte-client[82905]: System call of process 96910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img rebase -u -b volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.151s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.107s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.096s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.info" returned: 0 in 0.094s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.info" returned: 0 in 0.085s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.552s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:15 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c45b341a-15d3-4d0a-9394-d2dbb2c1a359 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot 19c47665-e565-45cd-a874-3f9f5167cc94: created successfully
Sep 10 19:38:15 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot 19c47665-e565-45cd-a874-3f9f5167cc94: deleting
Sep 10 19:38:15 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot 19c47665-e565-45cd-a874-3f9f5167cc94: deleting {{(pid=82863) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-7b144d9c-7878-4927-b9bc-596c059ca74f" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-7b144d9c-7878-4927-b9bc-596c059ca74f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Deleting offline snapshot 7b144d9c-7878-4927-b9bc-596c059ca74f of volume ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] snapshot_file for this snap is: volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d4b08-586b-4c95-bc4b-5b3b1dd6bcd5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:15 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.405s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cabf9d-beb9-4fe3-bb2a-987214f68f41]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0" returned: 0 in 0.410s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:16 devstack quobyte-client[82905]: System call of process 96923 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.255s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0.7b144d9c-7878-4927-b9bc-596c059ca74f" returned: 0 in 0.113s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-7b144d9c-7878-4927-b9bc-596c059ca74f" released by "_delete_snapshot" :: held 1.494s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" released by "delete_snapshot" :: held 1.522s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:17 devstack cinder-volume[82863]: WARNING cinder.quota [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1932494833 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1932494833, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:17 devstack cinder-volume[82863]: WARNING cinder.quota [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1932494833 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1932494833, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:17 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['dce5592b-b1c5-4af2-b58c-ae9d77ba50a2', '97e8bdab-dfd7-439c-9b79-70aadb3820e7', 'e4a5c9f8-568a-4a15-a713-5ee725f9fc7d', '710b7343-ae50-459b-9443-30e34d53aaad'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f5d4a4df-8d64-4dad-a169-6e0dfe1fe627 tempest-GroupSnapshotsTest-1047407689 None] group_snapshot 19c47665-e565-45cd-a874-3f9f5167cc94: deleted successfully
Sep 10 19:38:18 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee1547a-6620-4edd-b077-9d5288a80032]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0" returned: 0 in 0.416s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ae7a1055-7eaa-466b-8128-3efdb8e861a0" returned: 0 in 0.122s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Lock "cinder-quobyte-ae7a1055-7eaa-466b-8128-3efdb8e861a0" released by "delete_volume" :: held 0.700s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['f86ed173-7862-400f-90b5-dafdedc44d35'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:19 devstack cinder-volume[82863]: WARNING cinder.quota [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1932494833 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1932494833, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Created reservations ['25929ead-8832-4a0d-9281-7b623d46bf68', 'c0df816e-b3cb-41f1-9b08-315d11e57404', 'af50930d-f29a-414e-b31b-c95a0266a4dd', '992e4fb8-9e04-4f72-9889-ea8686e1cbbf'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:19 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:19 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2fbf5eb5-64f6-4132-816a-608e688c9547 tempest-GroupSnapshotsTest-1047407689 None] Delete group completed successfully.
Sep 10 19:38:27 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=98,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-09ef33ac-8c1a-429a-a7cf-88e217608d0d tempest-GroupsV320Test-1611163596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-09ef33ac-8c1a-429a-a7cf-88e217608d0d tempest-GroupsV320Test-1611163596 None] Group tempest-GroupsV320Test-Group-1464520844: creating
Sep 10 19:38:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-09ef33ac-8c1a-429a-a7cf-88e217608d0d tempest-GroupsV320Test-1611163596 None] Group tempest-GroupsV320Test-Group-1464520844: created successfully
Sep 10 19:38:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-09ef33ac-8c1a-429a-a7cf-88e217608d0d tempest-GroupsV320Test-1611163596 None] Create group completed successfully.
Sep 10 19:38:29 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Created reservations ['cb973db0-3f27-42e1-8396-f9b158d53acf'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.149s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:29 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b4b64adb-993b-4cfa-b387-157b83dfd68f tempest-GroupsV320Test-1611163596 None] Delete group completed successfully.
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.142s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:39 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:39 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=102,cinder:INSERT=16,cinder:UPDATE=94,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:38:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:45 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:38:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Flow 'volume_create_manager' (750daccf-f7ff-4a3e-98f3-c76c60123dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8ad40-7301-4417-a768-98f82351c9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db8ad40-7301-4417-a768-98f82351c9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-739227386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5809242-6d96-4d23-867b-661364135e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c981204abd3422691152db26a8e3450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:46Z,use_quota=True,user_id='bad13566d7bc40c994ee83b69f284b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a43521-0a96-46d3-81be-0f54e5c7c300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a43521-0a96-46d3-81be-0f54e5c7c300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc918c-fadd-479c-8a31-51473e39ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efc918c-fadd-479c-8a31-51473e39ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5809242-6d96-4d23-867b-661364135e70', 'volume_name': 'volume-b5809242-6d96-4d23-867b-661364135e70', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4543ba-20ea-44f5-84b2-457466d5c423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd4543ba-20ea-44f5-84b2-457466d5c423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d49f577-ab08-4c85-bac9-cbb997ad7718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume b5809242-6d96-4d23-867b-661364135e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5809242-6d96-4d23-867b-661364135e70', 'volume_size': 1}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-739227386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5809242-6d96-4d23-867b-661364135e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c981204abd3422691152db26a8e3450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:46Z,use_quota=True,user_id='bad13566d7bc40c994ee83b69f284b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Creating volume b5809242-6d96-4d23-867b-661364135e70 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:38:46 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:46 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=122, name=volume-b5809242-6d96-4d23-867b-661364135e70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70 1073741824" returned: 0 in 0.436s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] <== create_volume: return (649ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d49f577-ab08-4c85-bac9-cbb997ad7718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5809242-6d96-4d23-867b-661364135e70', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbb4a6e-5e69-4562-b190-6bcb36aea08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:46 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume volume-b5809242-6d96-4d23-867b-661364135e70 (b5809242-6d96-4d23-867b-661364135e70): created successfully
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbb4a6e-5e69-4562-b190-6bcb36aea08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Flow 'volume_create_manager' (750daccf-f7ff-4a3e-98f3-c76c60123dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-108dc0c9-398a-4ce9-828c-e62ea8916c11 tempest-VolumeQuotasAdminTestJSON-514199393 None] Created volume successfully.
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "cinder-b5809242-6d96-4d23-867b-661364135e70-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "cinder-b5809242-6d96-4d23-867b-661364135e70-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:48 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "cinder-quobyte-b5809242-6d96-4d23-867b-661364135e70" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "cinder-quobyte-b5809242-6d96-4d23-867b-661364135e70" acquired by "delete_volume" :: waited 0.030s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[565d0fef-e702-454a-9517-f4d57878b067]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70" returned: 0 in 0.396s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b5809242-6d96-4d23-867b-661364135e70" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "cinder-quobyte-b5809242-6d96-4d23-867b-661364135e70" released by "delete_volume" :: held 0.633s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Created reservations ['38f9fb5e-30bb-4da7-bcb2-d7f709c9f0e4', '3e6f780d-b2b6-42c6-a6da-c3920ee9a0d0', '50fd83d7-a5f7-4a7b-a7fb-cb99a7326417', '39952320-e91d-438c-b860-6eaeadf5cd66'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Deleted volume successfully.
Sep 10 19:38:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1a1bb84c-82f8-4977-921e-5f59187b63b8 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "cinder-b5809242-6d96-4d23-867b-661364135e70-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Flow 'volume_create_manager' (ac86f44b-9b59-4651-99ac-cca31d77f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868fd4ad-dee4-47ba-812e-c76974d3a1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868fd4ad-dee4-47ba-812e-c76974d3a1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106508423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5685e8f1-816c-461f-b393-26bdcd409a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c981204abd3422691152db26a8e3450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:51Z,use_quota=True,user_id='bad13566d7bc40c994ee83b69f284b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e784a4-d742-45bc-8328-26e814f5afa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e784a4-d742-45bc-8328-26e814f5afa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bd5056-27fb-455c-adb6-28e3d94b66e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6bd5056-27fb-455c-adb6-28e3d94b66e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5685e8f1-816c-461f-b393-26bdcd409a4b', 'volume_name': 'volume-5685e8f1-816c-461f-b393-26bdcd409a4b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4762d-0bce-4a14-bd33-0119f4d30cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56a4762d-0bce-4a14-bd33-0119f4d30cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1a1606-9455-4757-aa95-0401c78eac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:51 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume 5685e8f1-816c-461f-b393-26bdcd409a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5685e8f1-816c-461f-b393-26bdcd409a4b', 'volume_size': 1}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-106508423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5685e8f1-816c-461f-b393-26bdcd409a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c981204abd3422691152db26a8e3450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:38:51Z,use_quota=True,user_id='bad13566d7bc40c994ee83b69f284b32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Creating volume 5685e8f1-816c-461f-b393-26bdcd409a4b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:38:51 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:51 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=123, name=volume-5685e8f1-816c-461f-b393-26bdcd409a4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b 1073741824" returned: 0 in 0.351s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b" returned: 0 in 0.089s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] <== create_volume: return (532ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.545s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1a1606-9455-4757-aa95-0401c78eac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5685e8f1-816c-461f-b393-26bdcd409a4b', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:51 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20da8a8-4e58-4ef7-a539-a7e67af25fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:38:52 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Volume volume-5685e8f1-816c-461f-b393-26bdcd409a4b (5685e8f1-816c-461f-b393-26bdcd409a4b): created successfully
Sep 10 19:38:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20da8a8-4e58-4ef7-a539-a7e67af25fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:38:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Flow 'volume_create_manager' (ac86f44b-9b59-4651-99ac-cca31d77f663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:38:52 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-91be0120-f919-4734-b4fa-6ffeb41f1517 tempest-VolumeQuotasAdminTestJSON-514199393 None] Created volume successfully.
Sep 10 19:38:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-48c5c392-fa50-427e-888a-dc082ef88151 tempest-VolumeQuotasAdminTestJSON-793266628 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-48c5c392-fa50-427e-888a-dc082ef88151 tempest-VolumeQuotasAdminTestJSON-793266628 None] Transfer volume completed successfully.
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Acquiring lock "cinder-5685e8f1-816c-461f-b393-26bdcd409a4b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "cinder-5685e8f1-816c-461f-b393-26bdcd409a4b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Acquiring lock "cinder-quobyte-5685e8f1-816c-461f-b393-26bdcd409a4b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "cinder-quobyte-5685e8f1-816c-461f-b393-26bdcd409a4b" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da42068-34f9-47ec-ba62-25357afe523e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:38:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b" returned: 0 in 0.419s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5685e8f1-816c-461f-b393-26bdcd409a4b" returned: 0 in 0.118s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "cinder-quobyte-5685e8f1-816c-461f-b393-26bdcd409a4b" released by "delete_volume" :: held 0.717s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:38:55 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Created reservations ['f746f311-9561-4a49-9d1b-6812c0d31199', '711ec77c-c253-4a1c-b052-692e9fc73712', 'd47f393e-1e07-411f-ac3e-61082c19b514', 'a4096001-9b48-4b37-8478-a8433295d534'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:38:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Deleted volume successfully.
Sep 10 19:38:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-be390b29-f61a-4f7f-86f5-2986253d0463 tempest-VolumeQuotasAdminTestJSON-1651416118 None] Lock "cinder-5685e8f1-816c-461f-b393-26bdcd409a4b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:05 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Flow 'volume_create_manager' (6a095370-ba91-4ee8-9c28-27fe6c30c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7facf91a-7d22-4b89-944d-fc5feb1537a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7facf91a-7d22-4b89-944d-fc5feb1537a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1991725515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505aab21-e76c-4db3-9f7a-0cb998d0a0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e300bc1491ef451da4a5965f52585469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:06Z,use_quota=True,user_id='2acfbad944134236ac3db99d0bb6cb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581139a9-e9f0-4466-8262-641be2ffd545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581139a9-e9f0-4466-8262-641be2ffd545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f77efdd-dac3-492d-b241-23e82fdd0042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f77efdd-dac3-492d-b241-23e82fdd0042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505aab21-e76c-4db3-9f7a-0cb998d0a0dc', 'volume_name': 'volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce91ca-562a-4521-87de-0f8f67a3a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cce91ca-562a-4521-87de-0f8f67a3a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d62e8-7a7d-4083-9cdc-9e411edee4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:05 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Volume 505aab21-e76c-4db3-9f7a-0cb998d0a0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc', 'volume_size': 1}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1991725515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505aab21-e76c-4db3-9f7a-0cb998d0a0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e300bc1491ef451da4a5965f52585469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:06Z,use_quota=True,user_id='2acfbad944134236ac3db99d0bb6cb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Creating volume 505aab21-e76c-4db3-9f7a-0cb998d0a0dc {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:05 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:39:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:06 devstack quobyte-client[82905]: System call of process 97002 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:06 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=124, name=volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc 1073741824" returned: 0 in 0.382s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] <== create_volume: return (574ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d62e8-7a7d-4083-9cdc-9e411edee4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4eb79-1b0b-4582-9ac3-7456fc241205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:06 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Volume volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc (505aab21-e76c-4db3-9f7a-0cb998d0a0dc): created successfully
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4eb79-1b0b-4582-9ac3-7456fc241205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Flow 'volume_create_manager' (6a095370-ba91-4ee8-9c28-27fe6c30c24f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-65250b2e-4268-4da4-93a5-3c743bb31776 tempest-VolumeQuotasNegativeTestJSON-985039232 None] Created volume successfully.
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Acquiring lock "cinder-505aab21-e76c-4db3-9f7a-0cb998d0a0dc-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "cinder-505aab21-e76c-4db3-9f7a-0cb998d0a0dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Acquiring lock "cinder-quobyte-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "cinder-quobyte-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319688d-deaf-4f1e-b07a-4e4a89135eb1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" returned: 0 in 0.407s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" returned: 0 in 0.094s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "cinder-quobyte-505aab21-e76c-4db3-9f7a-0cb998d0a0dc" released by "delete_volume" :: held 0.651s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Created reservations ['5fed8ed9-2755-4fcf-bd5f-3246bd24e436', '6b80a723-7502-48c4-98d4-b51caa2dc7c9', 'f273fa7d-132d-44c6-810c-58a14f0b0b91', 'bae0abec-3855-4783-87d3-d94835f28b37'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.117s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:10 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Deleted volume successfully.
Sep 10 19:39:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-98ea2b69-6dbf-48bd-9fac-f91e6d2f3e8c tempest-VolumeQuotasNegativeTestJSON-985039232 None] Lock "cinder-505aab21-e76c-4db3-9f7a-0cb998d0a0dc-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:17 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Flow 'volume_create_manager' (abacd7cb-7420-4937-a49e-47416dfe0e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec88e903-17a2-453b-8a58-a181c716705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec88e903-17a2-453b-8a58-a181c716705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1293762680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e1aa22-82a2-49d7-af24-4f35fe659263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69afdfcaa51c40abbd065f6475cd8d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:17Z,use_quota=True,user_id='a76ad4fcf6b3482da277eca6dbb041cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53df43-c448-40c2-842a-3b25b511883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d53df43-c448-40c2-842a-3b25b511883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e651d32f-b9d4-4a84-85b4-43746e345852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e651d32f-b9d4-4a84-85b4-43746e345852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e1aa22-82a2-49d7-af24-4f35fe659263', 'volume_name': 'volume-27e1aa22-82a2-49d7-af24-4f35fe659263', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c9b894-8245-40fb-9164-b3da239da982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c9b894-8245-40fb-9164-b3da239da982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfe2c93-e7e4-4000-8156-3cb26182055e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:17 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume 27e1aa22-82a2-49d7-af24-4f35fe659263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e1aa22-82a2-49d7-af24-4f35fe659263', 'volume_size': 1}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1293762680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e1aa22-82a2-49d7-af24-4f35fe659263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69afdfcaa51c40abbd065f6475cd8d8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:17Z,use_quota=True,user_id='a76ad4fcf6b3482da277eca6dbb041cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Creating volume 27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:17 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:39:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:17 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=125, name=volume-27e1aa22-82a2-49d7-af24-4f35fe659263, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 1073741824" returned: 0 in 0.425s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263" returned: 0 in 0.094s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] <== create_volume: return (614ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.626s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfe2c93-e7e4-4000-8156-3cb26182055e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e1aa22-82a2-49d7-af24-4f35fe659263', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42551e89-14f5-4efa-9410-cd43c411aa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:18 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume volume-27e1aa22-82a2-49d7-af24-4f35fe659263 (27e1aa22-82a2-49d7-af24-4f35fe659263): created successfully
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42551e89-14f5-4efa-9410-cd43c411aa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:18 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Flow 'volume_create_manager' (abacd7cb-7420-4937-a49e-47416dfe0e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:18 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-345b6af6-6ad2-41bb-99b5-06789fe8f3fd tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Created volume successfully.
Sep 10 19:39:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:19 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Creating offline snapshot cfe62639-8b66-4b3d-a463-f0362127a874 of volume 27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[831516e3-2bfa-4bfb-909d-b702d0b8a172]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263" returned: 0 in 0.432s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:20 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=126, name=volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 1G" returned: 0 in 0.260s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): qemu-img rebase -u -b volume-27e1aa22-82a2-49d7-af24-4f35fe659263 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:20 devstack quobyte-client[82905]: System call of process 97023 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "qemu-img rebase -u -b volume-27e1aa22-82a2-49d7-af24-4f35fe659263 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.155s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.117s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.info" returned: 0 in 0.112s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.info" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:21 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-dd04b12a-1785-4b0b-abd1-d86d65d38515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Create snapshot completed successfully
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "cinder-cfe62639-8b66-4b3d-a463-f0362127a874-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-cfe62639-8b66-4b3d-a463-f0362127a874-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "cinder-quobyte-cfe62639-8b66-4b3d-a463-f0362127a874" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-cfe62639-8b66-4b3d-a463-f0362127a874" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Deleting offline snapshot cfe62639-8b66-4b3d-a463-f0362127a874 of volume 27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] snapshot_file for this snap is: volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1fb2d5-f0b9-4be4-911b-4186bf7055f9]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.409s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27e1aa22-82a2-49d7-af24-4f35fe659263(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6fa46-80bf-441e-9d30-cc0e47a4c2cb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263" returned: 0 in 0.506s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:24 devstack quobyte-client[82905]: System call of process 97036 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.262s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263.cfe62639-8b66-4b3d-a463-f0362127a874" returned: 0 in 0.098s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-cfe62639-8b66-4b3d-a463-f0362127a874" released by "_delete_snapshot" :: held 1.585s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" released by "delete_snapshot" :: held 1.624s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Created reservations ['18de8cb3-b994-4046-8d4e-adbae92ad4f5', '9b673b82-9313-4ad9-8396-a39d120e0ed7', '350b298a-1b2d-419f-9b47-5430bc24a3c9', '8ddf6ce9-4c65-49f9-abea-35c56eaa3560'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Delete snapshot completed successfully.
Sep 10 19:39:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ddb204d2-bc20-41d6-8696-ba9523588503 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-cfe62639-8b66-4b3d-a463-f0362127a874-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "cinder-27e1aa22-82a2-49d7-af24-4f35fe659263-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-27e1aa22-82a2-49d7-af24-4f35fe659263-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221fb48-1dc1-4c4c-934d-245cdd551180]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263" returned: 0 in 0.442s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-27e1aa22-82a2-49d7-af24-4f35fe659263" returned: 0 in 0.118s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-quobyte-27e1aa22-82a2-49d7-af24-4f35fe659263" released by "delete_volume" :: held 0.719s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Created reservations ['20b3a3e0-a642-49b4-952c-19910a4c24b7', '2d4b800a-1e77-4d81-9e0e-43e543d2f74e', '6067e0fd-a457-4941-8df2-95382026b5b0', '7ccf7ab0-1be3-46f1-8172-77afe7f7b6c9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:27 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Deleted volume successfully.
Sep 10 19:39:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2e77aa9b-cb3c-4cd2-80a0-49105f11d4f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1580729653 None] Lock "cinder-27e1aa22-82a2-49d7-af24-4f35fe659263-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=54,cinder:DELETE=5,cinder:SELECT=31,cinder:INSERT=8 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.181s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=30,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:39 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:39:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Flow 'volume_create_manager' (3d78896a-11eb-4d1d-af6c-2e9af7b48655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dd83ed-a51d-40a8-94c8-a04fb619487a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88dd83ed-a51d-40a8-94c8-a04fb619487a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1595371347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7349c1f0-c97a-41a4-9ee7-668ef4e07f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c580179b2a34390b001ea5e931dac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:40Z,use_quota=True,user_id='670ad0488ec3452392628d742eb9ab81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12503b37-9ffe-4094-ae6a-d40e17fc46e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12503b37-9ffe-4094-ae6a-d40e17fc46e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e55e8a-0a73-4679-9c1e-ff911645c244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e55e8a-0a73-4679-9c1e-ff911645c244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7349c1f0-c97a-41a4-9ee7-668ef4e07f55', 'volume_name': 'volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a8629-8eb0-41b3-a5ac-afb99187cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500a8629-8eb0-41b3-a5ac-afb99187cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25daff35-1053-4c30-8471-1a5e571b6d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Volume 7349c1f0-c97a-41a4-9ee7-668ef4e07f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55', 'volume_size': 1}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1595371347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7349c1f0-c97a-41a4-9ee7-668ef4e07f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c580179b2a34390b001ea5e931dac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:39:40Z,use_quota=True,user_id='670ad0488ec3452392628d742eb9ab81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Creating volume 7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:39:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:40 devstack quobyte-client[82905]: System call of process 97080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=128, name=volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 1073741824" returned: 0 in 0.357s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] <== create_volume: return (552ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.564s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25daff35-1053-4c30-8471-1a5e571b6d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795bd76e-76cc-42d4-a0ee-1b8445340bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:39:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Volume volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 (7349c1f0-c97a-41a4-9ee7-668ef4e07f55): created successfully
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795bd76e-76cc-42d4-a0ee-1b8445340bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:39:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Flow 'volume_create_manager' (3d78896a-11eb-4d1d-af6c-2e9af7b48655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:39:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b0b926e4-6519-4b26-bf21-9fa3c17080e4 tempest-SnapshotMetadataTestJSON-1430053647 None] Created volume successfully.
Sep 10 19:39:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Creating offline snapshot 27f58f95-defb-4686-b4f7-1552215e6a8d of volume 7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[146c7351-3476-40c2-b04d-b3d681a228c6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" returned: 0 in 0.403s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=129, name=volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d 1G" returned: 0 in 0.270s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "qemu-img rebase -u -b volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.175s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.info" returned: 0 in 0.097s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.info" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.558s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:44 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a05be613-3537-4d81-88f7-8df76dd96827 tempest-SnapshotMetadataTestJSON-1430053647 None] Create snapshot completed successfully
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "cinder-27f58f95-defb-4686-b4f7-1552215e6a8d-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-27f58f95-defb-4686-b4f7-1552215e6a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "cinder-quobyte-27f58f95-defb-4686-b4f7-1552215e6a8d" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-27f58f95-defb-4686-b4f7-1552215e6a8d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Deleting offline snapshot 27f58f95-defb-4686-b4f7-1552215e6a8d of volume 7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] snapshot_file for this snap is: volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3674ffd0-18b1-410d-b4fe-12685ce86df3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.410s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[34afca7c-5ffb-430c-93c2-c42ae06f77e7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" returned: 0 in 0.430s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:46 devstack quobyte-client[82905]: System call of process 97106 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.259s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55.27f58f95-defb-4686-b4f7-1552215e6a8d" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-27f58f95-defb-4686-b4f7-1552215e6a8d" released by "_delete_snapshot" :: held 1.493s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" released by "delete_snapshot" :: held 1.519s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Created reservations ['0b05527b-29d5-437f-96f2-c01f09034a25', '421ed11c-941c-4c2e-8670-9f3c79c26237', '69778e4a-0f36-47d4-b642-2478723c8724', '933b3705-b705-4820-a05b-613f4bcc7ea1'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Delete snapshot completed successfully.
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-af9d1ef8-8e7e-4b53-b399-e3d8c1285c0e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-27f58f95-defb-4686-b4f7-1552215e6a8d-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "cinder-7349c1f0-c97a-41a4-9ee7-668ef4e07f55-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-7349c1f0-c97a-41a4-9ee7-668ef4e07f55-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" acquired by "delete_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710bd76-9829-410e-bf46-a1afddefba40]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:39:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" returned: 0 in 0.428s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-quobyte-7349c1f0-c97a-41a4-9ee7-668ef4e07f55" released by "delete_volume" :: held 0.690s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:48 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Created reservations ['71c5fb2a-0c21-4cb8-99f8-eb7eb375be7d', '65a657b9-6b17-435b-8bf1-3e4d560884ff', 'afd9942d-3b82-4733-84c6-f181280402e8', '5a49537d-f227-4296-9ad5-f8f135c5efb6'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.110s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:39:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Deleted volume successfully.
Sep 10 19:39:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-919d1fea-fc03-4095-9ec7-68644906ae2e tempest-SnapshotMetadataTestJSON-1430053647 None] Lock "cinder-7349c1f0-c97a-41a4-9ee7-668ef4e07f55-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:39:58 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=10,cinder:UPDATE=21,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:39:59 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:DELETE=3,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Flow 'volume_create_manager' (570cd65d-fe84-41e3-9004-35993585c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65da15a1-7564-4b3e-8886-1d218ae41f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65da15a1-7564-4b3e-8886-1d218ae41f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200077038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38790fde-a801-415e-a5b3-4a0e557ae9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f630caa93f64849996c7daaba60963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:07Z,use_quota=True,user_id='932bde5b9a884cc4803caefb0613a149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e0ca59-fd15-4604-a860-78aa654ec397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e0ca59-fd15-4604-a860-78aa654ec397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdad0c5-35ab-4485-9cf6-1231536f9800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fdad0c5-35ab-4485-9cf6-1231536f9800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38790fde-a801-415e-a5b3-4a0e557ae9be', 'volume_name': 'volume-38790fde-a801-415e-a5b3-4a0e557ae9be', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b678172-75f0-416b-8aed-7cbb7647755b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b678172-75f0-416b-8aed-7cbb7647755b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cdb7fe-751d-4b10-bf9f-aeb8276be2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:06 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Volume 38790fde-a801-415e-a5b3-4a0e557ae9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38790fde-a801-415e-a5b3-4a0e557ae9be', 'volume_size': 1}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1200077038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38790fde-a801-415e-a5b3-4a0e557ae9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f630caa93f64849996c7daaba60963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:40:07Z,use_quota=True,user_id='932bde5b9a884cc4803caefb0613a149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Creating volume 38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:40:06 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:40:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:07 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=131, name=volume-38790fde-a801-415e-a5b3-4a0e557ae9be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be 1073741824" returned: 0 in 0.346s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] <== create_volume: return (506ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.518s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06cdb7fe-751d-4b10-bf9f-aeb8276be2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38790fde-a801-415e-a5b3-4a0e557ae9be', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fcc4eb-2f9e-4221-8289-a7290bc7a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:40:07 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Volume volume-38790fde-a801-415e-a5b3-4a0e557ae9be (38790fde-a801-415e-a5b3-4a0e557ae9be): created successfully
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fcc4eb-2f9e-4221-8289-a7290bc7a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:40:07 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Flow 'volume_create_manager' (570cd65d-fe84-41e3-9004-35993585c516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:40:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-53486120-744a-450b-a5e8-3dd1b66cc621 tempest-VolumesActionsTest-953896226 None] Created volume successfully.
Sep 10 19:40:17 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:17 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" by "attach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" acquired by "attach_volume" :: waited 0.028s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:34 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Attaching volume 38790fde-a801-415e-a5b3-4a0e557ae9be to instance 417ae6c0-db0e-4d29-97dd-5a1951f32da7 at mountpoint /dev/vdb on host None.
Sep 10 19:40:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Attach volume completed successfully.
Sep 10 19:40:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-773fbf53-a666-4287-bcbd-8a1e840ca63f tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" released by "attach_volume" :: held 0.216s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" by "detach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:40:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:40:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Detaching volume 38790fde-a801-415e-a5b3-4a0e557ae9be from instance 417ae6c0-db0e-4d29-97dd-5a1951f32da7.
Sep 10 19:40:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:40:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Detach volume completed successfully.
Sep 10 19:40:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4a26fca6-b9a0-4a93-8de6-adc176c6435f tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:40:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:40:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.436s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:40:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:40:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:INSERT=1,cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:40:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" by "attach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" acquired by "attach_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Attaching volume 38790fde-a801-415e-a5b3-4a0e557ae9be to instance 5e5d10ab-cb70-4b88-8a1b-c00067c735ff at mountpoint /dev/vdb on host None.
Sep 10 19:41:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Attach volume completed successfully.
Sep 10 19:41:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-32ed095c-97f9-4dd5-925f-ccf7276c30e5 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be" released by "attach_volume" :: held 0.406s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" by "detach_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:41:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:41:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Detaching volume 38790fde-a801-415e-a5b3-4a0e557ae9be from instance 5e5d10ab-cb70-4b88-8a1b-c00067c735ff.
Sep 10 19:41:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Detach volume completed successfully.
Sep 10 19:41:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cbb10d17-1451-44fd-a9eb-e84a0cc124d9 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:41:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:19 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:41:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:19 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:20 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f676a-1f5b-4147-b9f6-bd744b83f775]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.447s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:20 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[189ccefb-38c7-4ac3-97ef-718dc87e8ff5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.436s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.31a29a3b-625a-4291-a83a-3276c0681cc9hif39lf6.img {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.31a29a3b-625a-4291-a83a-3276c0681cc9hif39lf6.img" returned: 0 in 7.281s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:28 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce77c07-3c6e-4230-850c-6c3e6367876b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:41:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.562s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:28 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.31a29a3b-625a-4291-a83a-3276c0681cc9hif39lf6.img {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:41:28 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Converted 1024.00 MB image at 140.26 MB/s
Sep 10 19:41:29 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] 31a29a3b-625a-4291-a83a-3276c0681cc9 was raw, no need to convert to raw {{(pid=82863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.193s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:41:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:41:39 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:39 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:41:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.349s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:41:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Uploaded volume to glance image-id: 31a29a3b-625a-4291-a83a-3276c0681cc9. {{(pid=82863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 19:41:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-487de09a-10a9-421b-9cde-7de34dbdcee2 tempest-VolumesActionsTest-953896226 None] Copy volume to image completed successfully.
Sep 10 19:42:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3379e820-ff51-4419-9936-33dcd3014ee8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.432s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:01 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43a6e2-ae21-4d9a-a601-ba51a353ecf4]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.398s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img" returned: 0 in 6.364s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3035dae1-cc9d-48fb-8edf-547eac9539b2]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.548s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:08 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:42:08 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Converted 1024.00 MB image at 160.32 MB/s
Sep 10 19:42:08 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] 9dd36e71-1b24-45e0-8c28-800e8965e19d was raw, converting to qcow2 {{(pid=82863) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 10 19:42:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf913f38-86fd-47c4-94bd-658f68ec7ee8]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img" returned: 0 in 0.384s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img" returned: 1 in 0.379s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img /opt/stack/data/cinder/conversion/vol_upload_qn4w1xh1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img /opt/stack/data/cinder/conversion/vol_upload_qn4w1xh1" returned: 0 in 0.160s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Image conversion details: src /opt/stack/data/cinder/conversion/38790fde-a801-415e-a5b3-4a0e557ae9be.temp_image.9dd36e71-1b24-45e0-8c28-800e8965e19dq8b1l9o9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qn4w1xh1 {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:42:09 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bbc5f5-6a96-4815-bde4-5075557687ab]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qn4w1xh1 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qn4w1xh1" returned: 0 in 0.353s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.926s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Uploaded volume to glance image-id: 9dd36e71-1b24-45e0-8c28-800e8965e19d. {{(pid=82863) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 10 19:42:11 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1ca7d9c4-eb8c-4460-8abc-49c8acc4a190 tempest-VolumesActionsTest-953896226 None] Copy volume to image completed successfully.
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:16 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Acquiring lock "cinder-quobyte-38790fde-a801-415e-a5b3-4a0e557ae9be" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "cinder-quobyte-38790fde-a801-415e-a5b3-4a0e557ae9be" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35fcb59-def8-4350-b33a-df77645197c8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.433s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:16 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-38790fde-a801-415e-a5b3-4a0e557ae9be" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "cinder-quobyte-38790fde-a801-415e-a5b3-4a0e557ae9be" released by "delete_volume" :: held 0.657s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Created reservations ['7d9e0335-2292-4537-91a3-978fd3ad6f16', 'c65886fb-7772-46a8-8b44-99d46ae352ca', '6d823bc0-f024-4939-9455-3676a4e352ff', 'bb4e199a-2daa-4401-9c9a-76f4f39d8390'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.085s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:17 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Deleted volume successfully.
Sep 10 19:42:17 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4c1f9701-d420-409c-9bcb-cabda06e2a22 tempest-VolumesActionsTest-953896226 None] Lock "cinder-38790fde-a801-415e-a5b3-4a0e557ae9be-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:27 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:42:27 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:42:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:28 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Flow 'volume_create_manager' (1cf881c4-7cfb-4a64-994a-1229ec6b8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea26fd59-4155-40b8-b59e-c8281c2b3697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea26fd59-4155-40b8-b59e-c8281c2b3697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1213580914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8529efe-df87-45dd-b124-a496587988ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755ea861b2d14d6ca90cb60e1534b2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:29Z,use_quota=True,user_id='be209506829e416abdd23b88e9a5474b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900bd2ef-73f5-4392-9d86-9be912e73104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900bd2ef-73f5-4392-9d86-9be912e73104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fd5d8c-1594-4345-9100-b304baa1612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1fd5d8c-1594-4345-9100-b304baa1612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8529efe-df87-45dd-b124-a496587988ef', 'volume_name': 'volume-a8529efe-df87-45dd-b124-a496587988ef', 'volume_size': 2}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e597e-7121-47a7-bb34-3c7ff5f7deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0e597e-7121-47a7-bb34-3c7ff5f7deb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da538ef6-760b-44a3-afe8-122bf5a583ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Volume a8529efe-df87-45dd-b124-a496587988ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8529efe-df87-45dd-b124-a496587988ef', 'volume_size': 2}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1213580914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8529efe-df87-45dd-b124-a496587988ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='755ea861b2d14d6ca90cb60e1534b2b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:29Z,use_quota=True,user_id='be209506829e416abdd23b88e9a5474b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Creating volume a8529efe-df87-45dd-b124-a496587988ef {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:29 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef 2147483648 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:29 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=132, name=volume-a8529efe-df87-45dd-b124-a496587988ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef 2147483648" returned: 0 in 0.539s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] <== create_volume: return (705ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:42:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da538ef6-760b-44a3-afe8-122bf5a583ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8529efe-df87-45dd-b124-a496587988ef', 'volume_size': 2}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f17d1a4-9a49-4c5b-a314-c6d26907202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Volume volume-a8529efe-df87-45dd-b124-a496587988ef (a8529efe-df87-45dd-b124-a496587988ef): created successfully
Sep 10 19:42:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f17d1a4-9a49-4c5b-a314-c6d26907202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Flow 'volume_create_manager' (1cf881c4-7cfb-4a64-994a-1229ec6b8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2340c41d-777d-4339-a8a3-7e057a71dc30 tempest-VolumesCloneNegativeTest-359562691 None] Created volume successfully.
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Acquiring lock "cinder-a8529efe-df87-45dd-b124-a496587988ef-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "cinder-a8529efe-df87-45dd-b124-a496587988ef-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Acquiring lock "cinder-quobyte-a8529efe-df87-45dd-b124-a496587988ef" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "cinder-quobyte-a8529efe-df87-45dd-b124-a496587988ef" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4c0f3-2d4e-4d8a-b685-1eb18f8add16]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef" returned: 0 in 0.411s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a8529efe-df87-45dd-b124-a496587988ef" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "cinder-quobyte-a8529efe-df87-45dd-b124-a496587988ef" released by "delete_volume" :: held 0.653s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Created reservations ['96eb6fab-cdbf-4f1b-beaf-0aadbcf5d3c6', 'a1f57868-fa3c-4602-980a-e1f6a3b1b74c', '965421e7-f8f4-4f11-8209-3e1de622026d', '291468fa-02bd-4a53-934c-6ab5b436c261'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:32 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Deleted volume successfully.
Sep 10 19:42:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4816a97d-52fb-4f86-a5ef-1e8246acf1d1 tempest-VolumesCloneNegativeTest-359562691 None] Lock "cinder-a8529efe-df87-45dd-b124-a496587988ef-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Flow 'volume_create_manager' (71de318a-20ea-4417-bb36-a9e52f4f7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa1783-e6da-449e-8fbd-60b77c06220a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40aa1783-e6da-449e-8fbd-60b77c06220a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-634647966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec72a4-0b52-48c2-b070-aec41efaee12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e395c9635094a3f9a400b8360b39992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:37Z,use_quota=True,user_id='536ab490dbba4be3b00d7e8b3c0130ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2130c8d-c0e4-46d4-b1df-ddb29b28dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2130c8d-c0e4-46d4-b1df-ddb29b28dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5129d3-714a-41e5-8aea-491f50d9fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b5129d3-714a-41e5-8aea-491f50d9fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ec72a4-0b52-48c2-b070-aec41efaee12', 'volume_name': 'volume-c0ec72a4-0b52-48c2-b070-aec41efaee12', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c6ffc2-0a6d-4fc1-8801-4e015131f3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26c6ffc2-0a6d-4fc1-8801-4e015131f3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b77d3ca-a40a-440e-8f73-310c870835b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume c0ec72a4-0b52-48c2-b070-aec41efaee12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ec72a4-0b52-48c2-b070-aec41efaee12', 'volume_size': 1}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-634647966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ec72a4-0b52-48c2-b070-aec41efaee12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e395c9635094a3f9a400b8360b39992',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:42:37Z,use_quota=True,user_id='536ab490dbba4be3b00d7e8b3c0130ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Creating volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:36 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:42:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:37 devstack quobyte-client[82905]: System call of process 97592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:37 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=133, name=volume-c0ec72a4-0b52-48c2-b070-aec41efaee12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 1073741824" returned: 0 in 0.327s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.651s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.261s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b77d3ca-a40a-440e-8f73-310c870835b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ec72a4-0b52-48c2-b070-aec41efaee12', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3ee243-07f3-4e00-9b9d-f8c9f2405cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 (c0ec72a4-0b52-48c2-b070-aec41efaee12): created successfully
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3ee243-07f3-4e00-9b9d-f8c9f2405cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Flow 'volume_create_manager' (71de318a-20ea-4417-bb36-a9e52f4f7b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ee3df46f-a880-4f3b-a9d9-9801b8388373 tempest-VolumesSnapshotListTestJSON-1537367471 None] Created volume successfully.
Sep 10 19:42:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Creating offline snapshot 74a4d811-de79-41cc-a7f8-551e88409555 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66c2c8-48ec-4633-9047-e001edf96a57]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12" returned: 0 in 0.423s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:39 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=134, name=volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 1G" returned: 0 in 0.241s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.131s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.084s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.105s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.info" returned: 0 in 0.101s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.info" returned: 0 in 0.097s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.515s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f0cbb6f-fec1-44ae-81ff-62f0b532a37b tempest-VolumesSnapshotListTestJSON-1537367471 None] Create snapshot completed successfully
Sep 10 19:42:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Creating offline snapshot f3589b0c-0a64-4aa6-809f-d45b2504d9d5 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:42:41 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d9c82-0ffc-4ab7-8c52-908a759f7b58]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.383s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:42 devstack quobyte-client[82905]: System call of process 97646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:42 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=136, name=volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 1G" returned: 0 in 0.251s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.109s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.232s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a878d619-697c-420b-bb07-cbae6662e5d5 tempest-VolumesSnapshotListTestJSON-1537367471 None] Create snapshot completed successfully
Sep 10 19:42:43 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Creating offline snapshot baadc852-9541-44a2-b65e-6bfd3f5b4396 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2bf2e3-975f-4d46-967f-11fdf654c705]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.372s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:44 devstack quobyte-client[82905]: System call of process 97659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:42:44 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=137, name=volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 1G" returned: 0 in 0.303s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img rebase -u -b volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.156s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:42:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.092s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:42:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.309s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d815363c-2194-4895-8474-95f6dc7e5a3d tempest-VolumesSnapshotListTestJSON-1537367471 None] Create snapshot completed successfully
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-baadc852-9541-44a2-b65e-6bfd3f5b4396-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-baadc852-9541-44a2-b65e-6bfd3f5b4396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-baadc852-9541-44a2-b65e-6bfd3f5b4396" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-baadc852-9541-44a2-b65e-6bfd3f5b4396" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Deleting offline snapshot baadc852-9541-44a2-b65e-6bfd3f5b4396 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] snapshot_file for this snap is: volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0862baca-42ca-41cd-b2f2-d2c08c704fe4]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.375s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c2d6c-03ea-419d-935b-e5caa8956542]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.372s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.275s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.baadc852-9541-44a2-b65e-6bfd3f5b4396" returned: 0 in 0.090s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-baadc852-9541-44a2-b65e-6bfd3f5b4396" released by "_delete_snapshot" :: held 1.379s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" released by "delete_snapshot" :: held 1.410s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Created reservations ['8745ae1d-1f00-4c19-875b-859b2185cd29', 'd03e4d3c-2699-424e-b284-e8812f6d9489', 'addfba58-b42a-4617-91f8-c1ab05c01fa8', '109257e5-ea7f-4276-9167-446e9cb26bac'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Delete snapshot completed successfully.
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b393574a-2a8c-4d42-968f-5629564fc85b tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-baadc852-9541-44a2-b65e-6bfd3f5b4396-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-f3589b0c-0a64-4aa6-809f-d45b2504d9d5-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-f3589b0c-0a64-4aa6-809f-d45b2504d9d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-f3589b0c-0a64-4aa6-809f-d45b2504d9d5" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-f3589b0c-0a64-4aa6-809f-d45b2504d9d5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Deleting offline snapshot f3589b0c-0a64-4aa6-809f-d45b2504d9d5 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] snapshot_file for this snap is: volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[199c8864-cab2-4ed3-b696-2eceb08d3b6d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.431s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a6d256-2b13-49cf-984a-15954f290978]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.395s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.239s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.f3589b0c-0a64-4aa6-809f-d45b2504d9d5" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-f3589b0c-0a64-4aa6-809f-d45b2504d9d5" released by "_delete_snapshot" :: held 1.453s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" released by "delete_snapshot" :: held 1.488s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Created reservations ['6f5f9286-fd97-4852-be23-b58cbb955ea0', '7d128a07-9557-44d3-8746-34428c25445d', '183d6193-8a29-4598-9ef5-37226afa897a', '5edc5216-ea26-49cf-8a0f-c87032aa045f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Delete snapshot completed successfully.
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-993ee150-2ce9-4438-8940-4f894e7ceb17 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-f3589b0c-0a64-4aa6-809f-d45b2504d9d5-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-74a4d811-de79-41cc-a7f8-551e88409555-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-74a4d811-de79-41cc-a7f8-551e88409555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-74a4d811-de79-41cc-a7f8-551e88409555" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-74a4d811-de79-41cc-a7f8-551e88409555" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Deleting offline snapshot 74a4d811-de79-41cc-a7f8-551e88409555 of volume c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] snapshot_file for this snap is: volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce4d5ff-c2ed-4778-85a8-d856946586a7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.376s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ec72a4-0b52-48c2-b070-aec41efaee12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5fedc8-e067-46f4-86c3-2b8234819640]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12" returned: 0 in 0.398s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.226s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12.74a4d811-de79-41cc-a7f8-551e88409555" returned: 0 in 0.086s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-74a4d811-de79-41cc-a7f8-551e88409555" released by "_delete_snapshot" :: held 1.345s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" released by "delete_snapshot" :: held 1.399s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Created reservations ['5d81b397-5aa0-44f2-b2a9-853617fd4020', '6810fa84-0b63-4890-97ad-5a53be783efe', '360d4d1b-c313-4462-a436-c1a929310adc', 'a8f90f9b-1c84-4585-9361-41df52502913'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Delete snapshot completed successfully.
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5aa48ba7-d614-4a2e-9b07-a7128bce4476 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-74a4d811-de79-41cc-a7f8-551e88409555-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-c0ec72a4-0b52-48c2-b070-aec41efaee12-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-c0ec72a4-0b52-48c2-b070-aec41efaee12-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5788f7fa-5ac5-45aa-9ed2-c3e0fed513e1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12" returned: 0 in 0.409s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c0ec72a4-0b52-48c2-b070-aec41efaee12" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-quobyte-c0ec72a4-0b52-48c2-b070-aec41efaee12" released by "delete_volume" :: held 0.672s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Created reservations ['16cc301c-438f-48b4-9698-17f8706d6b5a', '9437f32a-e6f5-4aa7-8656-837b56374083', '0ff27e88-a4ca-472d-ad82-fe4f3677575b', 'eb30bde4-0be8-4e17-aae9-cf1d5fc6171c'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.082s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:42:55 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Deleted volume successfully.
Sep 10 19:42:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-73e16ca7-98f4-406d-b8cb-ac4c73fb4b65 tempest-VolumesSnapshotListTestJSON-1537367471 None] Lock "cinder-c0ec72a4-0b52-48c2-b070-aec41efaee12-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:42:59 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Flow 'volume_create_manager' (0da5f2e9-7acd-4351-910d-f5aa5c0316db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46410387-7dfc-4dc2-961e-760da588340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46410387-7dfc-4dc2-961e-760da588340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1443318105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38ebdca-2931-413b-ae47-4008c38c53ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01c6c410764da5b8406760498324b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:00Z,use_quota=True,user_id='adec68eef8a148cfb6bb66b901b7b379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd55d9a-3e8f-4663-8df8-185395b2d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd55d9a-3e8f-4663-8df8-185395b2d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42049c2-9409-4d99-8159-e5cc566b0893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42049c2-9409-4d99-8159-e5cc566b0893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38ebdca-2931-413b-ae47-4008c38c53ee', 'volume_name': 'volume-c38ebdca-2931-413b-ae47-4008c38c53ee', 'volume_size': 2}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79055198-9add-4374-8f97-7f358a7d332f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79055198-9add-4374-8f97-7f358a7d332f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7effea38-322b-4f85-b284-56d94ad7f31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:42:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume c38ebdca-2931-413b-ae47-4008c38c53ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38ebdca-2931-413b-ae47-4008c38c53ee', 'volume_size': 2}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1443318105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38ebdca-2931-413b-ae47-4008c38c53ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01c6c410764da5b8406760498324b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:00Z,use_quota=True,user_id='adec68eef8a148cfb6bb66b901b7b379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Creating volume c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:42:59 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:42:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee 2147483648 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:00 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=138, name=volume-c38ebdca-2931-413b-ae47-4008c38c53ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee 2147483648" returned: 0 in 0.528s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee" returned: 0 in 0.111s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] <== create_volume: return (701ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7effea38-322b-4f85-b284-56d94ad7f31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38ebdca-2931-413b-ae47-4008c38c53ee', 'volume_size': 2}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687e933e-f8cd-4457-8e80-fc8693fc00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:00 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume volume-c38ebdca-2931-413b-ae47-4008c38c53ee (c38ebdca-2931-413b-ae47-4008c38c53ee): created successfully
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687e933e-f8cd-4457-8e80-fc8693fc00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Flow 'volume_create_manager' (0da5f2e9-7acd-4351-910d-f5aa5c0316db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:00 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0f1b12fb-9434-4ac8-bcf4-186225ed9e46 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Created volume successfully.
Sep 10 19:43:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Creating offline snapshot cd06f2bb-1800-4685-818c-9fa90c69a68c of volume c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb67c9-ae4e-4716-8b0f-6f25eb3f9980]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee" returned: 0 in 0.408s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c 2G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:03 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=139, name=volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c 2G" returned: 0 in 0.272s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c38ebdca-2931-413b-ae47-4008c38c53ee -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "qemu-img rebase -u -b volume-c38ebdca-2931-413b-ae47-4008c38c53ee -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.192s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.113s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.info" returned: 0 in 0.091s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:43:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.info" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.602s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:04 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-0f8e82d9-cbb8-4f51-bc39-e79cad515df3 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Create snapshot completed successfully
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "cinder-cd06f2bb-1800-4685-818c-9fa90c69a68c-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-cd06f2bb-1800-4685-818c-9fa90c69a68c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:43:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "cinder-quobyte-cd06f2bb-1800-4685-818c-9fa90c69a68c" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-cd06f2bb-1800-4685-818c-9fa90c69a68c" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Deleting offline snapshot cd06f2bb-1800-4685-818c-9fa90c69a68c of volume c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] snapshot_file for this snap is: volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d507cbeb-3ed8-41c6-bbee-85a0e510a9fb]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:05 devstack quobyte-client[82905]: System call of process 97727 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:43:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.593s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c38ebdca-2931-413b-ae47-4008c38c53ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:43:05 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b87da-5feb-4f3a-900f-d8a1b7fbf672]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee" returned: 0 in 0.504s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:06 devstack quobyte-client[82905]: System call of process 97734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.214s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee.cd06f2bb-1800-4685-818c-9fa90c69a68c" returned: 0 in 0.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-cd06f2bb-1800-4685-818c-9fa90c69a68c" released by "_delete_snapshot" :: held 1.736s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" released by "delete_snapshot" :: held 1.790s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:43:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Created reservations ['f91d9def-c094-4a77-b983-975b3e262c01', '12aa4168-c8e1-4789-859e-60ded5787dfb', '6dcf95ec-5c7b-420e-829a-5afa3251cd1c', 'b00fb32c-0f08-4b29-9d46-d5015f663bc5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:43:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Delete snapshot completed successfully.
Sep 10 19:43:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-3ca6c4aa-5355-4b56-8401-10587e4b95d2 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-cd06f2bb-1800-4685-818c-9fa90c69a68c-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "cinder-c38ebdca-2931-413b-ae47-4008c38c53ee-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-c38ebdca-2931-413b-ae47-4008c38c53ee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:43:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" acquired by "delete_volume" :: waited 0.010s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d798e-414a-4791-962c-2162967ae2c3]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee" returned: 0 in 0.433s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-c38ebdca-2931-413b-ae47-4008c38c53ee" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-quobyte-c38ebdca-2931-413b-ae47-4008c38c53ee" released by "delete_volume" :: held 0.687s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Created reservations ['1e6f7a74-aa59-49d2-92c2-b2bf058f8b25', '91262772-b647-4113-8bcd-59e1bb37eb90', 'f5c06593-33ff-4344-b1a5-a359d5d44b09', 'b4869af6-aed4-4c74-81c8-55620e3e9795'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.082s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:43:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Deleted volume successfully.
Sep 10 19:43:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-77202c48-9e5b-4d92-bebd-97fdfb8f16c0 tempest-VolumesSnapshotNegativeTestJSON-1476120846 None] Lock "cinder-c38ebdca-2931-413b-ae47-4008c38c53ee-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:43:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=47,cinder:DELETE=6,cinder:SELECT=39,cinder:INSERT=16 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=45,cinder:UPDATE=65,cinder:INSERT=12,cinder:DELETE=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.105s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:43:39 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (03470875-d8ae-4ae6-ac22-9cb72a275f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6d34fc-4230-4486-9b55-5f4cd3b0876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6d34fc-4230-4486-9b55-5f4cd3b0876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-200933483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eb3f2a-184b-4db6-babe-3f46a92efcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:39Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a41bd2e8-9260-4de7-b3b7-eddcd5c389ab),volume_type_id=a41bd2e8-9260-4de7-b3b7-eddcd5c389ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d372fa81-a3c9-4f07-b553-4885af881dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d372fa81-a3c9-4f07-b553-4885af881dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e04502-3e7a-4dab-b8bf-403f77e64fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e04502-3e7a-4dab-b8bf-403f77e64fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26eb3f2a-184b-4db6-babe-3f46a92efcaf', 'volume_name': 'volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d20a6d-1efa-4eb0-8e4e-f727896aa0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d20a6d-1efa-4eb0-8e4e-f727896aa0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f92a30-87fc-44e1-bb3d-4199add7e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:39 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume 26eb3f2a-184b-4db6-babe-3f46a92efcaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf', 'volume_size': 1}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-200933483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26eb3f2a-184b-4db6-babe-3f46a92efcaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:39Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a41bd2e8-9260-4de7-b3b7-eddcd5c389ab),volume_type_id=a41bd2e8-9260-4de7-b3b7-eddcd5c389ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Creating volume 26eb3f2a-184b-4db6-babe-3f46a92efcaf {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:43:39 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:43:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=141, name=volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf 1073741824" returned: 0 in 0.540s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (5b559461-c3a9-4428-be43-214c57bdcf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700a8a2f-06ee-4188-975d-c259510a6fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf" returned: 0 in 0.489s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] <== create_volume: return (1079ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:43:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (700a8a2f-06ee-4188-975d-c259510a6fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963934064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f2434-cf7a-4673-919f-3d69c2c1e596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:40Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9488c6c7-a8c4-4157-9abc-75247c7a6b10),volume_type_id=9488c6c7-a8c4-4157-9abc-75247c7a6b10)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d937d52-9f4f-4f40-b40f-47c5a0817cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d937d52-9f4f-4f40-b40f-47c5a0817cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13eafcce-c68b-434b-b37d-d6db59912120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13eafcce-c68b-434b-b37d-d6db59912120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '544f2434-cf7a-4673-919f-3d69c2c1e596', 'volume_name': 'volume-544f2434-cf7a-4673-919f-3d69c2c1e596', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2946b26-81d5-490d-b9b0-010893fee844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2946b26-81d5-490d-b9b0-010893fee844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559d34bb-bf7d-4445-a89c-fecdeeae7ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Volume 544f2434-cf7a-4673-919f-3d69c2c1e596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-544f2434-cf7a-4673-919f-3d69c2c1e596', 'volume_size': 1}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-963934064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=544f2434-cf7a-4673-919f-3d69c2c1e596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:40Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9488c6c7-a8c4-4157-9abc-75247c7a6b10),volume_type_id=9488c6c7-a8c4-4157-9abc-75247c7a6b10)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Creating volume 544f2434-cf7a-4673-919f-3d69c2c1e596 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:43:41 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:41 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=142, name=volume-544f2434-cf7a-4673-919f-3d69c2c1e596, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f92a30-87fc-44e1-bb3d-4199add7e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7615f603-2386-4e97-9790-d27f67235a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (eec30422-d9bf-487c-b190-a849f1194175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c947fcaf-064b-40d0-b52c-78825dc2bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf (26eb3f2a-184b-4db6-babe-3f46a92efcaf): created successfully
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7615f603-2386-4e97-9790-d27f67235a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (03470875-d8ae-4ae6-ac22-9cb72a275f91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 1073741824" returned: 0 in 0.560s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-697083b9-48b6-45da-9a73-000940ca8b00 tempest-TestInstancesWithCinderVolumes-530994109 None] Created volume successfully.
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c947fcaf-064b-40d0-b52c-78825dc2bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1062962679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed90535-fdc7-4a64-b7a6-f06771e0569a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:41Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d70d77a-829b-4fef-8303-afaf34621fdf),volume_type_id=3d70d77a-829b-4fef-8303-afaf34621fdf)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac30134c-9096-4633-a5a1-e08eae59efaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac30134c-9096-4633-a5a1-e08eae59efaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcdd11a-53cd-4087-ac31-637bc8b4f5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596" returned: 0 in 0.513s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] <== create_volume: return (1106ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559d34bb-bf7d-4445-a89c-fecdeeae7ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-544f2434-cf7a-4673-919f-3d69c2c1e596', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66b4fe-d7bc-4f35-bf33-2841443659f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Volume volume-544f2434-cf7a-4673-919f-3d69c2c1e596 (544f2434-cf7a-4673-919f-3d69c2c1e596): created successfully
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66b4fe-d7bc-4f35-bf33-2841443659f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (5b559461-c3a9-4428-be43-214c57bdcf8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbcdd11a-53cd-4087-ac31-637bc8b4f5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ed90535-fdc7-4a64-b7a6-f06771e0569a', 'volume_name': 'volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a', 'volume_size': 1, 'image_id': '2dc50051-a557-41b9-827f-39e46eafb110', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--493090322', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6185cc829429440eb3e71a1dc7034bb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2dc50051-a557-41b9-827f-39e46eafb110', 'created_at': datetime.datetime(2025, 9, 10, 17, 43, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 43, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dc50051-a557-41b9-827f-39e46eafb110/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce690f0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1888300c-fc07-4376-80aa-c6ae8a6d76f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1888300c-fc07-4376-80aa-c6ae8a6d76f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae21491-1337-456d-83f7-f2371517f993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a', 'volume_size': 1, 'image_id': '2dc50051-a557-41b9-827f-39e46eafb110', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--493090322', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6185cc829429440eb3e71a1dc7034bb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2dc50051-a557-41b9-827f-39e46eafb110', 'created_at': datetime.datetime(2025, 9, 10, 17, 43, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 43, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dc50051-a557-41b9-827f-39e46eafb110/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce690f0>}
Sep 10 19:43:42 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Cloning 2ed90535-fdc7-4a64-b7a6-f06771e0569a from image 2dc50051-a557-41b9-827f-39e46eafb110  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:43:42 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-91927576-50f3-4170-8451-17db212ccdff tempest-TestInstancesWithCinderVolumes-530994109 None] Created volume successfully.
Sep 10 19:43:43 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD, size 20.69 MB, duration 1.45 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:43:43 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Image download 20.69 MB at 14.27 MB/s
Sep 10 19:43:43 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b8c88d-193f-4654-9a66-bf5db987ddc1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:44 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD
Sep 10 19:43:44 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:43:45 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Sep 10 19:43:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD" returned: 0 in 2.063s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:45 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Temporary image 2dc50051-a557-41b9-827f-39e46eafb110 is fetched for user 3a9d39d4179c442c829c91cb819b4cfb. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:43:46 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4b102a-7ed2-4e3d-8d0c-24a9584e71e8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:46 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD
Sep 10 19:43:46 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:43:48 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD" returned: 0 in 1.939s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1062962679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed90535-fdc7-4a64-b7a6-f06771e0569a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6185cc829429440eb3e71a1dc7034bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:43:41Z,use_quota=True,user_id='3a9d39d4179c442c829c91cb819b4cfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d70d77a-829b-4fef-8303-afaf34621fdf),volume_type_id=3d70d77a-829b-4fef-8303-afaf34621fdf)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Creating volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:43:48 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:48 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=143, name=volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a 1073741824" returned: 0 in 0.304s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] <== create_volume: return (472ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.503s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:43:48 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Attempting download of 2dc50051-a557-41b9-827f-39e46eafb110 ((None, None)) to volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b7ddc-76b1-40fb-8f4a-e318fc643875]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dc50051-a557-41b9-827f-39e46eafb110__nfyvcvo {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dc50051-a557-41b9-827f-39e46eafb110__nfyvcvo" returned: 0 in 0.364s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dc50051-a557-41b9-827f-39e46eafb110__nfyvcvo {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dc50051-a557-41b9-827f-39e46eafb110__nfyvcvo" returned: 1 in 0.334s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dc50051-a557-41b9-827f-39e46eafb110__nfyvcvo' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1042068-dbf5-4091-a0e7-7a826b00975c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:50 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] 2dc50051-a557-41b9-827f-39e46eafb110 was qcow2, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:43:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:50 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=143, name=volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.987s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2dc50051-a557-41b9-827f-39e46eafb110_xfu1n83idevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:43:51 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Converted 112.00 MB image at 110.85 MB/s
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a 1G" returned: 0 in 0.126s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b13402-8e5e-458f-a26f-abeb32bef8ea]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.366s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 1 in 0.334s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Downloaded image 2dc50051-a557-41b9-827f-39e46eafb110 ((None, None)) to volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Temporary image 2dc50051-a557-41b9-827f-39e46eafb110 for user 3a9d39d4179c442c829c91cb819b4cfb is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Marking volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Copying metadata from image 2dc50051-a557-41b9-827f-39e46eafb110 to 2ed90535-fdc7-4a64-b7a6-f06771e0569a. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Creating volume glance metadata for volume 2ed90535-fdc7-4a64-b7a6-f06771e0569a backed by image 2dc50051-a557-41b9-827f-39e46eafb110 with: {'image_id': '2dc50051-a557-41b9-827f-39e46eafb110', 'image_name': 'tempest-scenario-img--493090322', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae21491-1337-456d-83f7-f2371517f993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a', 'volume_size': 1, 'image_id': '2dc50051-a557-41b9-827f-39e46eafb110', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--493090322', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6185cc829429440eb3e71a1dc7034bb3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2dc50051-a557-41b9-827f-39e46eafb110', 'created_at': datetime.datetime(2025, 9, 10, 17, 43, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 43, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dc50051-a557-41b9-827f-39e46eafb110/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce690f0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa4400d-4af3-4119-8f3a-44cb06a8c194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:43:52 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Volume volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a (2ed90535-fdc7-4a64-b7a6-f06771e0569a): created successfully
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aa4400d-4af3-4119-8f3a-44cb06a8c194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:43:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Flow 'volume_create_manager' (eec30422-d9bf-487c-b190-a849f1194175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:43:52 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a1d14732-2ea3-44b9-9137-94166d69a4bb tempest-TestInstancesWithCinderVolumes-530994109 None] Created volume successfully.
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e19763e-bb1e-429f-b84a-f3d1e1220900]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.419s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 1 in 0.379s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:44:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:44:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfd315eb-10d6-4a85-bc8c-4612a54c38f4', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:44:03 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:44:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-2b827dd5-7f8b-490d-a4e2-9042935285ad req-d2242dda-1c0e-40ec-a696-4c3c612d4be2 tempest-TestInstancesWithCinderVolumes-530994109 None] attachment_update completed successfully.
Sep 10 19:44:13 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=12,cinder:SELECT=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:44:13 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=10,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=6 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.112s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:44:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:45:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:45:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:45:34 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd064075-ac48-4789-8eb1-845dccbd00ba]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:45:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:45:35 devstack quobyte-client[82905]: System call of process 98441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:45:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf" returned: 0 in 0.451s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:45:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.518s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:45:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad320522-28be-4c94-900c-b68cd387dbbf', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:45:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:45:35 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-9f903ded-5220-4611-800f-103bf7f05c5b req-643faa90-6fd9-4dfc-bcc5-a061ee44502c tempest-TestInstancesWithCinderVolumes-530994109 None] attachment_update completed successfully.
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.114s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:45:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:45:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:45:45 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc98c93-6e52-46b3-9812-76a34bde44c2]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596" returned: 0 in 0.394s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.471s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:45:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-544f2434-cf7a-4673-919f-3d69c2c1e596', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5241659c-56c6-45f1-9d17-1996b0230fd9', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:45:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:45:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-228f7a4b-0efe-4686-b79f-12299bd2749f req-ccc8579f-2a47-4646-b88e-b246b6def4b4 tempest-TestInstancesWithCinderVolumes-530994109 None] attachment_update completed successfully.
Sep 10 19:45:58 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:45:58 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-723cfcb9-6d7b-4c07-8e12-7f87b698abe3 req-eca29f13-30a7-450b-ac5b-fb0706ea53c9 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:22 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-723cfcb9-6d7b-4c07-8e12-7f87b698abe3 req-eca29f13-30a7-450b-ac5b-fb0706ea53c9 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:22 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-723cfcb9-6d7b-4c07-8e12-7f87b698abe3 req-eca29f13-30a7-450b-ac5b-fb0706ea53c9 tempest-TestInstancesWithCinderVolumes-530994109 None] Terminate volume connection completed successfully.
Sep 10 19:46:22 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-723cfcb9-6d7b-4c07-8e12-7f87b698abe3 req-eca29f13-30a7-450b-ac5b-fb0706ea53c9 tempest-TestInstancesWithCinderVolumes-530994109 None] Deleting attachment ad320522-28be-4c94-900c-b68cd387dbbf. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-26eb3f2a-184b-4db6-babe-3f46a92efcaf-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-26eb3f2a-184b-4db6-babe-3f46a92efcaf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:23 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-quobyte-26eb3f2a-184b-4db6-babe-3f46a92efcaf" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-26eb3f2a-184b-4db6-babe-3f46a92efcaf" acquired by "delete_volume" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78f2e4-d171-4d8a-8b2a-43577fc98135]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:24 devstack quobyte-client[82905]: System call of process 98592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:46:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf" returned: 0 in 0.574s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-26eb3f2a-184b-4db6-babe-3f46a92efcaf" returned: 0 in 0.130s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-26eb3f2a-184b-4db6-babe-3f46a92efcaf" released by "delete_volume" :: held 0.876s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:46:24 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-884669833-1718414300 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-884669833-1718414300, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:46:24 devstack cinder-volume[82863]: WARNING cinder.quota [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-884669833-1718414300 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-884669833-1718414300, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Created reservations ['175b2e88-e794-434d-9f95-306c618eec03', 'c5032368-0215-476e-8536-3abcc5213cf9', '51470d7e-1fb9-480e-97f4-ce9058faa752', '76b9e7dc-c1d8-4380-92fc-7146f74bb891'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:46:25 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Deleted volume successfully.
Sep 10 19:46:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-cdbaab7a-13e2-4220-8f74-6af4d11375f4 tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-26eb3f2a-184b-4db6-babe-3f46a92efcaf-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:46:35 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:35 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.092s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:46:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-503b60c6-ee32-4953-96cd-44abd87b4c2f req-e65e5122-13c1-486e-ad22-64dd1a88026c tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-503b60c6-ee32-4953-96cd-44abd87b4c2f req-e65e5122-13c1-486e-ad22-64dd1a88026c tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:52 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-503b60c6-ee32-4953-96cd-44abd87b4c2f req-e65e5122-13c1-486e-ad22-64dd1a88026c tempest-TestInstancesWithCinderVolumes-530994109 None] Terminate volume connection completed successfully.
Sep 10 19:46:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-503b60c6-ee32-4953-96cd-44abd87b4c2f req-e65e5122-13c1-486e-ad22-64dd1a88026c tempest-TestInstancesWithCinderVolumes-530994109 None] Deleting attachment 5241659c-56c6-45f1-9d17-1996b0230fd9. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:46:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-544f2434-cf7a-4673-919f-3d69c2c1e596-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-544f2434-cf7a-4673-919f-3d69c2c1e596-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:54 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:46:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-quobyte-544f2434-cf7a-4673-919f-3d69c2c1e596" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:46:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-544f2434-cf7a-4673-919f-3d69c2c1e596" acquired by "delete_volume" :: waited 0.018s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:46:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ddddb6-f386-4b7e-b449-df771fad3357]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:46:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596" returned: 0 in 0.538s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-544f2434-cf7a-4673-919f-3d69c2c1e596" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-544f2434-cf7a-4673-919f-3d69c2c1e596" released by "delete_volume" :: held 0.830s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:46:56 devstack cinder-volume[82863]: WARNING cinder.quota [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1456129394-219017928 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1456129394-219017928, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:46:56 devstack cinder-volume[82863]: WARNING cinder.quota [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1456129394-219017928 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1456129394-219017928, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Created reservations ['45279fec-b483-4eaa-ae62-a075dc11e5a5', 'ed75bd31-e14a-4f7d-9ee1-ca3aee871dbb', '716a93ff-2a43-4452-8837-642292e557b9', 'd090f6be-9824-48e0-90e0-f3e8a1cac69e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.149s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:46:56 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Deleted volume successfully.
Sep 10 19:46:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ee95cb33-b87e-4591-b7e9-118520f655fb tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-544f2434-cf7a-4673-919f-3d69c2c1e596-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:03 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-08911b33-c5ac-403c-b937-fa152955feb5 req-43b316df-dcc2-43bf-ac6f-be80fdd2bb15 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:03 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-08911b33-c5ac-403c-b937-fa152955feb5 req-43b316df-dcc2-43bf-ac6f-be80fdd2bb15 tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-08911b33-c5ac-403c-b937-fa152955feb5 req-43b316df-dcc2-43bf-ac6f-be80fdd2bb15 tempest-TestInstancesWithCinderVolumes-530994109 None] Terminate volume connection completed successfully.
Sep 10 19:47:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-08911b33-c5ac-403c-b937-fa152955feb5 req-43b316df-dcc2-43bf-ac6f-be80fdd2bb15 tempest-TestInstancesWithCinderVolumes-530994109 None] Deleting attachment cfd315eb-10d6-4a85-bc8c-4612a54c38f4. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-2ed90535-fdc7-4a64-b7a6-f06771e0569a-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-2ed90535-fdc7-4a64-b7a6-f06771e0569a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:07 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "cinder-quobyte-2ed90535-fdc7-4a64-b7a6-f06771e0569a" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-2ed90535-fdc7-4a64-b7a6-f06771e0569a" acquired by "delete_volume" :: waited 0.023s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbf7b89-07a8-4476-932d-66c48e5d3b38]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.371s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 1 in 0.355s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-2ed90535-fdc7-4a64-b7a6-f06771e0569a" returned: 0 in 0.110s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-quobyte-2ed90535-fdc7-4a64-b7a6-f06771e0569a" released by "delete_volume" :: held 1.175s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:09 devstack cinder-volume[82863]: WARNING cinder.quota [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909367603-1007192516 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909367603-1007192516, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:47:09 devstack cinder-volume[82863]: WARNING cinder.quota [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909367603-1007192516 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1909367603-1007192516, it is now deprecated. Please use the default quota class for default quota.
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Created reservations ['5fc56874-b034-44b7-906d-a02b9e6ae021', '97694b33-5338-47ce-8aa4-59c981ac0a15', '71ac5328-b3a7-4784-b90f-39587bf0d47d', 'e028f2a4-ea5d-422f-a26c-68f1d09f4d02'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.124s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:09 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Deleted volume successfully.
Sep 10 19:47:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7f040b31-3b14-45d1-8165-99f9282ae84c tempest-TestInstancesWithCinderVolumes-530994109 None] Lock "cinder-2ed90535-fdc7-4a64-b7a6-f06771e0569a-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:47:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=13,cinder:INSERT=6,cinder:UPDATE=21 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:47:19 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=11,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:47:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Flow 'volume_create_manager' (256a76cd-fe92-4105-b9af-370ba1129ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02b849-25fe-4eff-892e-195e55e03fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc02b849-25fe-4eff-892e-195e55e03fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901613699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cc3c9c-19f3-46ca-a3f6-8f180ead711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9b3dd001e648128efce52e5ec0fc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:52Z,use_quota=True,user_id='11e95a58a04942f0a9f3565a335b7f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3392c9b1-67b2-41d0-840c-20db3e99c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3392c9b1-67b2-41d0-840c-20db3e99c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1790ed63-d348-41b7-bd5f-0848b9cbec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1790ed63-d348-41b7-bd5f-0848b9cbec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'volume_name': 'volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce8d750>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229176a1-fa9f-44ed-94aa-b2c67164d51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229176a1-fa9f-44ed-94aa-b2c67164d51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49928b-9470-43d0-ad7f-851f8abdee0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:47:52 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce8d750>}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Cloning 07cc3c9c-19f3-46ca-a3f6-8f180ead711b from image be25800b-1081-46e6-8ee9-2b7d02b2963b  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:47:52 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Image download 20.69 MB at 20.69 MB/s
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ed65cc-c55b-4bc2-a31d-b8b070761937]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:53 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD
Sep 10 19:47:53 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:54 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD" returned: 0 in 2.072s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:55 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b is fetched for user 11e95a58a04942f0a9f3565a335b7f52. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:47:55 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d50527-e650-4cd9-bc86-d1ec360dca83]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:55 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD
Sep 10 19:47:55 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:47:57 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD" returned: 0 in 1.929s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1901613699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cc3c9c-19f3-46ca-a3f6-8f180ead711b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9b3dd001e648128efce52e5ec0fc16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:47:52Z,use_quota=True,user_id='11e95a58a04942f0a9f3565a335b7f52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Creating volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:47:57 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:57 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=144, name=volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b 1073741824" returned: 0 in 0.308s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.088s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] <== create_volume: return (476ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.507s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:47:57 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Attempting download of be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fc68d9-1883-4e69-95db-47cfb0736f19]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_haygfdyp {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_haygfdyp" returned: 0 in 0.358s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_haygfdyp {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_haygfdyp" returned: 1 in 0.339s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be25800b-1081-46e6-8ee9-2b7d02b2963b_haygfdyp' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93f7f6-dff0-4025-8215-cd9fe282c699]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:47:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:47:59 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] be25800b-1081-46e6-8ee9-2b7d02b2963b was qcow2, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:47:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:47:59 devstack quobyte-client[82905]: System call of process 98806 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:47:59 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=144, name=volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 1.110s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be25800b-1081-46e6-8ee9-2b7d02b2963b_y9cf334cdevstack@QuobyteHD, size 112.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:48:00 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Converted 112.00 MB image at 98.74 MB/s
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b 1G" returned: 0 in 0.161s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc89ebe-3c43-4a11-85a8-9c9f6f9fe710]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.348s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 1 in 0.349s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Downloaded image be25800b-1081-46e6-8ee9-2b7d02b2963b ((None, None)) to volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Temporary image be25800b-1081-46e6-8ee9-2b7d02b2963b for user 11e95a58a04942f0a9f3565a335b7f52 is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Marking volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Copying metadata from image be25800b-1081-46e6-8ee9-2b7d02b2963b to 07cc3c9c-19f3-46ca-a3f6-8f180ead711b. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Creating volume glance metadata for volume 07cc3c9c-19f3-46ca-a3f6-8f180ead711b backed by image be25800b-1081-46e6-8ee9-2b7d02b2963b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49928b-9470-43d0-ad7f-851f8abdee0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'volume_size': 1, 'image_id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e700f6e274647af91b1d8327528fdb8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be25800b-1081-46e6-8ee9-2b7d02b2963b', 'created_at': datetime.datetime(2025, 9, 10, 16, 55, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 16, 55, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be25800b-1081-46e6-8ee9-2b7d02b2963b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0ce8d750>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca0b95b-bd78-476a-91ba-645fde9ca043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:48:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Volume volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b (07cc3c9c-19f3-46ca-a3f6-8f180ead711b): created successfully
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca0b95b-bd78-476a-91ba-645fde9ca043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:48:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Flow 'volume_create_manager' (256a76cd-fe92-4105-b9af-370ba1129ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:48:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-75bcef88-8a55-4338-8b24-5a46489e6762 tempest-TestShelveInstance-767490831 None] Created volume successfully.
Sep 10 19:48:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:11 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea92f3-258c-4f26-9a11-05bd9e07181d]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:48:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=4,cinder:SELECT=12,cinder:INSERT=9,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:48:12 devstack quobyte-client[82905]: System call of process 98833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.703s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 1 in 0.498s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.309s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:12 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aff178e1-a8c4-4454-aa00-563033d414dd', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:48:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:48:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-18b88d60-a416-46a0-81b5-7381140ad8bf req-43bd853c-df96-438a-8cc4-33938f4517a9 tempest-TestShelveInstance-767490831 None] attachment_update completed successfully.
Sep 10 19:48:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=4 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:48:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.126s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:48:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.181s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:49:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-738b436d-6d27-41ca-8596-088fa6312097 req-db51452e-c499-4f99-89de-36d9f8cb9ff8 tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-738b436d-6d27-41ca-8596-088fa6312097 req-db51452e-c499-4f99-89de-36d9f8cb9ff8 tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-738b436d-6d27-41ca-8596-088fa6312097 req-db51452e-c499-4f99-89de-36d9f8cb9ff8 tempest-TestShelveInstance-767490831 None] Terminate volume connection completed successfully.
Sep 10 19:49:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-738b436d-6d27-41ca-8596-088fa6312097 req-db51452e-c499-4f99-89de-36d9f8cb9ff8 tempest-TestShelveInstance-767490831 None] Deleting attachment aff178e1-a8c4-4454-aa00-563033d414dd. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:49:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:49:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:49:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6968ff-8f44-4fc3-9253-01a06bc414ad]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:49:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.349s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 1 in 0.347s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.871s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:49:52 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779', 'name': 'volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7849dc1-0f03-461a-b8b0-e973f895de7b', 'enforce_multipath': True} {{(pid=82863) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 10 19:49:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:49:53 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-e0d99e26-4acf-4c78-a64c-0aa9a0a7abf4 req-264e034d-b029-4fde-b3ce-ea2836fd1b41 tempest-TestShelveInstance-767490831 None] attachment_update completed successfully.
Sep 10 19:50:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:11 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:50:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:51:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-84ac27fa-12a6-4307-989e-5a18d66d148e tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:24 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-84ac27fa-12a6-4307-989e-5a18d66d148e tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:24 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-84ac27fa-12a6-4307-989e-5a18d66d148e tempest-TestShelveInstance-767490831 None] Terminate volume connection completed successfully.
Sep 10 19:51:24 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-84ac27fa-12a6-4307-989e-5a18d66d148e tempest-TestShelveInstance-767490831 None] Deleting attachment e7849dc1-0f03-461a-b8b0-e973f895de7b. {{(pid=82863) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 10 19:51:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Acquiring lock "cinder-07cc3c9c-19f3-46ca-a3f6-8f180ead711b-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:51:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "cinder-07cc3c9c-19f3-46ca-a3f6-8f180ead711b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:51:25 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Acquiring lock "cinder-quobyte-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "cinder-quobyte-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622d809-5547-4493-ab62-6f35f4345b47]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:25 devstack quobyte-client[82905]: System call of process 100129 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.425s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:25 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:26 devstack quobyte-client[82905]: System call of process 100131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 1 in 0.419s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" returned: 0 in 0.081s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "cinder-quobyte-07cc3c9c-19f3-46ca-a3f6-8f180ead711b" released by "delete_volume" :: held 1.211s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG cinder.quota [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Created reservations ['3a2bb037-e8ef-4e1b-9b29-8c11ffc9ac8d', '595d83f4-0f70-4cd8-8a38-329937ed4e45', '71003766-042c-4dd2-940e-ac4a48efd9c5', '83208072-633a-4166-801b-4d6b6215771e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.100s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:26 devstack cinder-volume[82863]: DEBUG cinder.manager [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:51:26 devstack cinder-volume[82863]: INFO cinder.volume.manager [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Deleted volume successfully.
Sep 10 19:51:27 devstack cinder-volume[82863]: DEBUG cinder.coordination [req-657175ac-503a-4429-9f59-59dcc3c4eb2e req-963d0cdd-f0f6-41c5-abe7-82d3b1af294c tempest-TestShelveInstance-767490831 None] Lock "cinder-07cc3c9c-19f3-46ca-a3f6-8f180ead711b-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:51:36 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.140s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:51:48 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Flow 'volume_create_manager' (f348704c-7ef3-40cd-8f38-d269de6792fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4df3aa-7ed1-486e-8b57-82407b054c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4df3aa-7ed1-486e-8b57-82407b054c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c1718d-41ad-42bc-8cc2-0d92be50c012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0599707b4446c7b4761da618eeaf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:51:48Z,use_quota=True,user_id='45889c96f996436bb9b45e772ac34dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ceff6e-0406-4eb6-a2d9-c5f729cebdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ceff6e-0406-4eb6-a2d9-c5f729cebdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33120628-d4e3-415a-a668-be2212dc8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33120628-d4e3-415a-a668-be2212dc8bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10c1718d-41ad-42bc-8cc2-0d92be50c012', 'volume_name': 'volume-10c1718d-41ad-42bc-8cc2-0d92be50c012', 'volume_size': 1, 'image_id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bfef78129be3d060f0d56033726e0717', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b0599707b4446c7b4761da618eeaf01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3341905c8f6f15682e2c5fbf6ffed4baeab5528820c04ae3dadc336b041c0d961f28cac6aad87c687ffdcb9a4e8723873d6e9de3651fe5e8b7f03993b288f0e0', 'id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'created_at': datetime.datetime(2025, 9, 10, 17, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2858848-a584-4a93-80f1-a4f43f04cdd9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171e5f90>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70942fe6-f346-409c-97db-6efe02c3d669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70942fe6-f346-409c-97db-6efe02c3d669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59997dd-5050-49ef-9574-87085d73e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:51:48 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Volume 10c1718d-41ad-42bc-8cc2-0d92be50c012: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10c1718d-41ad-42bc-8cc2-0d92be50c012', 'volume_size': 1, 'image_id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bfef78129be3d060f0d56033726e0717', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b0599707b4446c7b4761da618eeaf01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3341905c8f6f15682e2c5fbf6ffed4baeab5528820c04ae3dadc336b041c0d961f28cac6aad87c687ffdcb9a4e8723873d6e9de3651fe5e8b7f03993b288f0e0', 'id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'created_at': datetime.datetime(2025, 9, 10, 17, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2858848-a584-4a93-80f1-a4f43f04cdd9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171e5f90>}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Cloning 10c1718d-41ad-42bc-8cc2-0d92be50c012 from image a2858848-a584-4a93-80f1-a4f43f04cdd9  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:51:48 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a923739-41f0-40ca-a582-234bda50cee5]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:49 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD
Sep 10 19:51:49 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:51:50 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 10 19:51:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 0 in 2.276s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:51 devstack sudo[100187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD
Sep 10 19:51:51 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:51:52 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root
Sep 10 19:51:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 1 in 1.999s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:51:52 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Temporary image a2858848-a584-4a93-80f1-a4f43f04cdd9 is fetched for user 45889c96f996436bb9b45e772ac34dcb. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:51:53 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dfb74f-0180-4239-8bf1-d82a7a3f6bf2]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:53 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD
Sep 10 19:51:53 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:51:55 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Sep 10 19:51:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 0 in 1.918s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:55 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD
Sep 10 19:51:55 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:51:57 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 1 in 2.022s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10c1718d-41ad-42bc-8cc2-0d92be50c012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0599707b4446c7b4761da618eeaf01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:51:48Z,use_quota=True,user_id='45889c96f996436bb9b45e772ac34dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Creating volume 10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:51:57 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:57 devstack quobyte-client[82905]: System call of process 100202 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:51:57 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=145, name=volume-10c1718d-41ad-42bc-8cc2-0d92be50c012, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 1073741824" returned: 0 in 0.378s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 0 in 0.087s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] <== create_volume: return (559ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:51:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Attempting download of a2858848-a584-4a93-80f1-a4f43f04cdd9 ((None, None)) to volume 10c1718d-41ad-42bc-8cc2-0d92be50c012. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fc31c-fc77-4b8d-a125-43f9df1fa2e8]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2858848-a584-4a93-80f1-a4f43f04cdd9_ffrbhp2x {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a2858848-a584-4a93-80f1-a4f43f04cdd9_ffrbhp2x" returned: 0 in 0.332s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2858848-a584-4a93-80f1-a4f43f04cdd9_ffrbhp2x {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2858848-a584-4a93-80f1-a4f43f04cdd9_ffrbhp2x" returned: 1 in 0.379s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a2858848-a584-4a93-80f1-a4f43f04cdd9_ffrbhp2x' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d50c2-5b14-4b77-b111-73abe34d864b]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:51:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] a2858848-a584-4a93-80f1-a4f43f04cdd9 was raw, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:51:59 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=145, name=volume-10c1718d-41ad-42bc-8cc2-0d92be50c012, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 0 in 0.148s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a2858848-a584-4a93-80f1-a4f43f04cdd9_abzjyswwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:51:59 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 19:51:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 1G" returned: 0 in 0.133s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991c6e6-a40e-4988-a6fb-48dec933610f]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 0 in 0.364s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 1 in 0.376s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Downloaded image a2858848-a584-4a93-80f1-a4f43f04cdd9 ((None, None)) to volume 10c1718d-41ad-42bc-8cc2-0d92be50c012 successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Temporary image a2858848-a584-4a93-80f1-a4f43f04cdd9 for user 45889c96f996436bb9b45e772ac34dcb is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Marking volume 10c1718d-41ad-42bc-8cc2-0d92be50c012 as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Copying metadata from image a2858848-a584-4a93-80f1-a4f43f04cdd9 to 10c1718d-41ad-42bc-8cc2-0d92be50c012. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Creating volume glance metadata for volume 10c1718d-41ad-42bc-8cc2-0d92be50c012 backed by image a2858848-a584-4a93-80f1-a4f43f04cdd9 with: {'image_id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bfef78129be3d060f0d56033726e0717', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59997dd-5050-49ef-9574-87085d73e077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c1718d-41ad-42bc-8cc2-0d92be50c012', 'volume_size': 1, 'image_id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bfef78129be3d060f0d56033726e0717', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2b0599707b4446c7b4761da618eeaf01', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3341905c8f6f15682e2c5fbf6ffed4baeab5528820c04ae3dadc336b041c0d961f28cac6aad87c687ffdcb9a4e8723873d6e9de3651fe5e8b7f03993b288f0e0', 'id': 'a2858848-a584-4a93-80f1-a4f43f04cdd9', 'created_at': datetime.datetime(2025, 9, 10, 17, 51, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 51, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a2858848-a584-4a93-80f1-a4f43f04cdd9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c171e5f90>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e36498-c05e-4e81-9d6f-c1eed4bd78a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:01 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Volume volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 (10c1718d-41ad-42bc-8cc2-0d92be50c012): created successfully
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e36498-c05e-4e81-9d6f-c1eed4bd78a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:01 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Flow 'volume_create_manager' (f348704c-7ef3-40cd-8f38-d269de6792fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-6b94fe2b-5a5d-4a91-8c85-0ba55ea524c9 tempest-VolumeImageDependencyTests-1575953432 None] Created volume successfully.
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Acquiring lock "cinder-10c1718d-41ad-42bc-8cc2-0d92be50c012-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "cinder-10c1718d-41ad-42bc-8cc2-0d92be50c012-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Acquiring lock "cinder-quobyte-10c1718d-41ad-42bc-8cc2-0d92be50c012" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "cinder-quobyte-10c1718d-41ad-42bc-8cc2-0d92be50c012" acquired by "delete_volume" :: waited 0.014s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15fce0f-847d-4c50-af91-3f1a3ad7de14]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 0 in 0.386s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 1 in 0.346s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-10c1718d-41ad-42bc-8cc2-0d92be50c012" returned: 0 in 0.097s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "cinder-quobyte-10c1718d-41ad-42bc-8cc2-0d92be50c012" released by "delete_volume" :: held 1.067s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Created reservations ['5fe5de4f-1628-4bd8-a94c-c8b7afe821b4', 'e4e48fd8-4fbc-4689-bbc9-a1e62534373f', '9ca6a39d-ef9c-41fe-a2f9-8f8e2b86c3a6', '07336039-b892-4a97-8c65-1c7abb42c835'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.096s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:03 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Deleted volume successfully.
Sep 10 19:52:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-48141850-61e4-4809-8973-53bca588a688 tempest-VolumeImageDependencyTests-1575953432 None] Lock "cinder-10c1718d-41ad-42bc-8cc2-0d92be50c012-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:13 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=5 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:14 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=8,cinder:DELETE=2 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:52:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (bd62c6e5-279a-40fb-a970-b2002032d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b1b032-1ee1-4206-bfc5-b14481f7db3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b1b032-1ee1-4206-bfc5-b14481f7db3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-996484894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a02faf-f91e-4a01-a014-1769e1cdc442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d8ce77-f38d-4d21-8c2b-1a9c4cdce82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d8ce77-f38d-4d21-8c2b-1a9c4cdce82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88bbe5-3014-4072-9bc2-bbb52b6e06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc88bbe5-3014-4072-9bc2-bbb52b6e06d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74a02faf-f91e-4a01-a014-1769e1cdc442', 'volume_name': 'volume-74a02faf-f91e-4a01-a014-1769e1cdc442', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17afca00-5e59-4e49-8ddb-1a0473586d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17afca00-5e59-4e49-8ddb-1a0473586d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ddafc5-efcb-4256-915b-171ec5d8b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:26 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Volume 74a02faf-f91e-4a01-a014-1769e1cdc442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74a02faf-f91e-4a01-a014-1769e1cdc442', 'volume_size': 1}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-996484894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74a02faf-f91e-4a01-a014-1769e1cdc442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Creating volume 74a02faf-f91e-4a01-a014-1769e1cdc442 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:26 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:26 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=146, name=volume-74a02faf-f91e-4a01-a014-1769e1cdc442, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (3845c88d-dcf2-44d6-866c-509a94e384c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34212073-39a1-446e-8f3d-8dbca09ce3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442 1073741824" returned: 0 in 1.019s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:27 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:27 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (21570795-d7eb-4070-8a11-cfa044f6a074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13aa275-9921-43a2-9ff6-49adf88eebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (498d68e6-077b-447f-8ca8-09e37ba1c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c90d0-b2a3-4fdc-af78-3be12314204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13aa275-9921-43a2-9ff6-49adf88eebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648368738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ffcc0d-88d4-4560-9b17-5c298d47fbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c125c0-b74f-4416-97b1-7a72f03bf57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c125c0-b74f-4416-97b1-7a72f03bf57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bdf8f-501c-49f6-8772-7b105fb7129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40bdf8f-501c-49f6-8772-7b105fb7129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ffcc0d-88d4-4560-9b17-5c298d47fbdb', 'volume_name': 'volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f243634-54f9-4703-884e-a7e6d68ec93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f243634-54f9-4703-884e-a7e6d68ec93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be7a02d-d40c-4697-9798-cac78c9f2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Volume 19ffcc0d-88d4-4560-9b17-5c298d47fbdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb', 'volume_size': 1}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34212073-39a1-446e-8f3d-8dbca09ce3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079828216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036c48c7-37d2-4f0c-88fa-589cf422e552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:27Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0b2f6-c91f-41b2-8018-f4b9f33d6fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d0b2f6-c91f-41b2-8018-f4b9f33d6fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aec0ba-947a-4810-baa8-4c331e8d4b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67aec0ba-947a-4810-baa8-4c331e8d4b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036c48c7-37d2-4f0c-88fa-589cf422e552', 'volume_name': 'volume-036c48c7-37d2-4f0c-88fa-589cf422e552', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f484fc19-fe0f-4ecb-a1f5-481e7e583084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f484fc19-fe0f-4ecb-a1f5-481e7e583084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349aa274-1be7-4a3b-8afd-0c409e8e40ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Volume 036c48c7-37d2-4f0c-88fa-589cf422e552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036c48c7-37d2-4f0c-88fa-589cf422e552', 'volume_size': 1}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8c90d0-b2a3-4fdc-af78-3be12314204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1964293100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0578d700-8e0f-49ad-a183-539ee1cab0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bee8dd-efdc-4b58-9064-ef5b26b0173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9bee8dd-efdc-4b58-9064-ef5b26b0173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90803546-2d27-4257-a825-4cfe04fcb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90803546-2d27-4257-a825-4cfe04fcb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0578d700-8e0f-49ad-a183-539ee1cab0b4', 'volume_name': 'volume-0578d700-8e0f-49ad-a183-539ee1cab0b4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601f2e7-1b4d-4494-870b-e2304812212e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9601f2e7-1b4d-4494-870b-e2304812212e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0189277-d94d-4688-be04-38e138169c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume 0578d700-8e0f-49ad-a183-539ee1cab0b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0578d700-8e0f-49ad-a183-539ee1cab0b4', 'volume_size': 1}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (191df237-cfa1-4200-86c0-6aaac5b71c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c6756-b3e5-4866-ba66-59113032cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442" returned: 0 in 0.962s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384c6756-b3e5-4866-ba66-59113032cb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91753252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62002d6-9b7f-49a8-9f52-1ce907f1cec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:27Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8989cf5e-da8d-481b-8465-c85b225865ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8989cf5e-da8d-481b-8465-c85b225865ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c848e3-c42d-428d-b09a-c001bf36c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1c848e3-c42d-428d-b09a-c001bf36c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62002d6-9b7f-49a8-9f52-1ce907f1cec8', 'volume_name': 'volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d5c7cb-580d-4ba6-b5f4-cc8f0f02633e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79d5c7cb-580d-4ba6-b5f4-cc8f0f02633e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8f1451-e1fb-4c1e-96fa-8ace1e480df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Volume a62002d6-9b7f-49a8-9f52-1ce907f1cec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8', 'volume_size': 1}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] <== create_volume: return (2069ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648368738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ffcc0d-88d4-4560-9b17-5c298d47fbdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Creating volume 19ffcc0d-88d4-4560-9b17-5c298d47fbdb {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:28 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:28 devstack quobyte-client[82905]: System call of process 100289 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:28 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=147, name=volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ddafc5-efcb-4256-915b-171ec5d8b331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74a02faf-f91e-4a01-a014-1769e1cdc442', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62896a7-dbfe-4e75-9ebc-622cd0949245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:28 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (25d7b4c2-e82e-4e2a-a55c-7d7a0f7612cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:28 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776e6c0c-6342-487e-8425-6dab9724a714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Volume volume-74a02faf-f91e-4a01-a014-1769e1cdc442 (74a02faf-f91e-4a01-a014-1769e1cdc442): created successfully
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62896a7-dbfe-4e75-9ebc-622cd0949245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (bd62c6e5-279a-40fb-a970-b2002032d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb 1073741824" returned: 0 in 0.612s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:29 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-77369504-679f-4186-8e29-548a445ca37b tempest-CreateVolumesFromImageTest-127842520 None] Created volume successfully.
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776e6c0c-6342-487e-8425-6dab9724a714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685273437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e66fe6-f431-4888-b2f9-3b2676d24388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:28Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d635cb1c-b0ff-4af3-ae58-ee587f51f044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d635cb1c-b0ff-4af3-ae58-ee587f51f044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcbea5f-6608-4058-a896-e7d5b3d9736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcbea5f-6608-4058-a896-e7d5b3d9736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5e66fe6-f431-4888-b2f9-3b2676d24388', 'volume_name': 'volume-f5e66fe6-f431-4888-b2f9-3b2676d24388', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34062e96-55c4-43ac-ab11-e33619c4c506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34062e96-55c4-43ac-ab11-e33619c4c506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd1c80-fa39-47a1-924b-2fed47b5372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Volume f5e66fe6-f431-4888-b2f9-3b2676d24388: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5e66fe6-f431-4888-b2f9-3b2676d24388', 'volume_size': 1}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" returned: 0 in 0.429s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] <== create_volume: return (1060ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1079828216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036c48c7-37d2-4f0c-88fa-589cf422e552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:27Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Creating volume 036c48c7-37d2-4f0c-88fa-589cf422e552 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:29 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:29 devstack quobyte-client[82905]: System call of process 100293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:29 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=148, name=volume-036c48c7-37d2-4f0c-88fa-589cf422e552, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be7a02d-d40c-4697-9798-cac78c9f2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cb69f6-cce8-43d7-ac0b-343ed5023ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Volume volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb (19ffcc0d-88d4-4560-9b17-5c298d47fbdb): created successfully
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cb69f6-cce8-43d7-ac0b-343ed5023ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (21570795-d7eb-4070-8a11-cfa044f6a074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552 1073741824" returned: 0 in 0.463s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:30 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-49cf2eed-9080-475b-be94-779be3fa6516 tempest-CreateVolumesFromImageTest-127842520 None] Created volume successfully.
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552" returned: 0 in 0.295s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] <== create_volume: return (784ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1964293100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0578d700-8e0f-49ad-a183-539ee1cab0b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:26Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume 0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:30 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:30 devstack quobyte-client[82905]: System call of process 100297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:30 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=149, name=volume-0578d700-8e0f-49ad-a183-539ee1cab0b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349aa274-1be7-4a3b-8afd-0c409e8e40ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036c48c7-37d2-4f0c-88fa-589cf422e552', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e47fe3-3b6c-4dbb-b7ec-377add38af97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Volume volume-036c48c7-37d2-4f0c-88fa-589cf422e552 (036c48c7-37d2-4f0c-88fa-589cf422e552): created successfully
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59e47fe3-3b6c-4dbb-b7ec-377add38af97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (3845c88d-dcf2-44d6-866c-509a94e384c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 1073741824" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-446f9f26-4107-46e2-82b3-60049efa3cce tempest-CreateVolumesFromImageTest-127842520 None] Created volume successfully.
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4" returned: 0 in 0.253s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (795ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.789s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-91753252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a62002d6-9b7f-49a8-9f52-1ce907f1cec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:27Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Creating volume a62002d6-9b7f-49a8-9f52-1ce907f1cec8 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:31 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:31 devstack quobyte-client[82905]: System call of process 100301 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:31 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=150, name=volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0189277-d94d-4688-be04-38e138169c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0578d700-8e0f-49ad-a183-539ee1cab0b4', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d68539-a8db-4161-9cb4-3ef6ac3016ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 1073741824" returned: 0 in 0.543s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 (0578d700-8e0f-49ad-a183-539ee1cab0b4): created successfully
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d68539-a8db-4161-9cb4-3ef6ac3016ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (498d68e6-077b-447f-8ca8-09e37ba1c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" returned: 0 in 0.348s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] <== create_volume: return (922ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.677s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-685273437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5e66fe6-f431-4888-b2f9-3b2676d24388,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a3706e6e5054f61a516631806f03883',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:28Z,use_quota=True,user_id='7d0182857277489387cf50d826a49282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Creating volume f5e66fe6-f431-4888-b2f9-3b2676d24388 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:32 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:32 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-09ba2015-2ea5-4560-9d13-85d984b46955 tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:32 devstack quobyte-client[82905]: System call of process 100306 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:32 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=151, name=volume-f5e66fe6-f431-4888-b2f9-3b2676d24388, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8f1451-e1fb-4c1e-96fa-8ace1e480df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf823c-3877-4c3b-9d78-1b9582cfbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:32 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Volume volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 (a62002d6-9b7f-49a8-9f52-1ce907f1cec8): created successfully
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cf823c-3877-4c3b-9d78-1b9582cfbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (191df237-cfa1-4200-86c0-6aaac5b71c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 1073741824" returned: 0 in 0.550s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-09a30323-8583-4b2f-8450-7f6d7fa7f9ac tempest-CreateVolumesFromImageTest-127842520 None] Created volume successfully.
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388" returned: 0 in 0.454s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] <== create_volume: return (1046ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbd1c80-fa39-47a1-924b-2fed47b5372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5e66fe6-f431-4888-b2f9-3b2676d24388', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7aa674b-31b6-4ccb-9df0-597d7b37cc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Volume volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 (f5e66fe6-f431-4888-b2f9-3b2676d24388): created successfully
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7aa674b-31b6-4ccb-9df0-597d7b37cc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Flow 'volume_create_manager' (25d7b4c2-e82e-4e2a-a55c-7d7a0f7612cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:33 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-632030ba-a99c-453a-a745-baafc3dee0b4 tempest-CreateVolumesFromImageTest-127842520 None] Created volume successfully.
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating offline snapshot c7747fb9-d0a8-499d-b7bc-1288cf9bb97b of volume 0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[216aefe1-e722-4f5a-9d72-2b0b54d669d5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-f5e66fe6-f431-4888-b2f9-3b2676d24388-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4" returned: 0 in 0.811s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:34 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-f5e66fe6-f431-4888-b2f9-3b2676d24388-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:34 devstack quobyte-client[82905]: System call of process 100313 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:35 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=152, name=volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-quobyte-f5e66fe6-f431-4888-b2f9-3b2676d24388" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b 1G" returned: 0 in 0.616s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-f5e66fe6-f431-4888-b2f9-3b2676d24388" acquired by "delete_volume" :: waited 0.264s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dff0aa-d15f-4105-a5f8-b80bc5caceed]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img rebase -u -b volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.387s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.193s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:52:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.200s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388" returned: 0 in 0.764s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.info" returned: 0 in 0.263s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-f5e66fe6-f431-4888-b2f9-3b2676d24388" returned: 0 in 0.285s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.info" returned: 0 in 0.247s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.301s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-f5e66fe6-f431-4888-b2f9-3b2676d24388" released by "delete_volume" :: held 1.491s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4189e79f-3f6f-4358-b884-c08d48ebbbff tempest-CreateVolumesFromSnapshotTest-291541667 None] Create snapshot completed successfully
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Created reservations ['803ca526-1931-4d6b-bd50-e6493f8caa89', 'c1f9a408-8805-4513-a665-3a114e5804c1', '9e5f9987-cd09-43ef-a424-13c9142a858e', 'eabbecab-5a52-4f9e-93a2-2d29ba9287e5'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.382s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:37 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:37 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Deleted volume successfully.
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-a62002d6-9b7f-49a8-9f52-1ce907f1cec8-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.619s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-a62002d6-9b7f-49a8-9f52-1ce907f1cec8-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-901bd93f-1974-447b-8d29-72ddc5b2abd7 tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-f5e66fe6-f431-4888-b2f9-3b2676d24388-delete_volume" released by "delete_volume" :: held 3.924s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-quobyte-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d7fe2-c785-47d5-837a-34831e89991b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:39 devstack quobyte-client[82905]: System call of process 100329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" returned: 0 in 0.958s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (cf0870d4-ed1d-4792-969c-c6ec5827200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c907bc-bba5-4715-8aa6-4d9986501875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (53bf6170-6c97-40de-8a36-3002bc6c081a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8392b5-f355-4dee-99bb-3d9432a97524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c907bc-bba5-4715-8aa6-4d9986501875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502078112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e801a69-90fd-423f-bcfd-e192f0953709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:39Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b035a6-bd37-47f9-bb2b-251db05c9701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2b035a6-bd37-47f9-bb2b-251db05c9701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84e2acb-cb47-4f37-b221-6b95c813abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84e2acb-cb47-4f37-b221-6b95c813abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e801a69-90fd-423f-bcfd-e192f0953709', 'volume_name': 'volume-9e801a69-90fd-423f-bcfd-e192f0953709', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be4696b-a592-463d-afde-62bd2f5cf96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3be4696b-a592-463d-afde-62bd2f5cf96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74794bca-ea54-4867-979f-7422281c6d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:40 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume 9e801a69-90fd-423f-bcfd-e192f0953709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e801a69-90fd-423f-bcfd-e192f0953709', 'volume_size': 1}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502078112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e801a69-90fd-423f-bcfd-e192f0953709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:39Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume 9e801a69-90fd-423f-bcfd-e192f0953709 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=154, name=volume-9e801a69-90fd-423f-bcfd-e192f0953709, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" returned: 0 in 1.575s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8392b5-f355-4dee-99bb-3d9432a97524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863783639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5243ea-0ab1-4e24-a057-e3aa3af22901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:39Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230f033-d22a-4455-860a-73f7e021e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230f033-d22a-4455-860a-73f7e021e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1dae55-8136-44d2-a87a-3d4a587627a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1dae55-8136-44d2-a87a-3d4a587627a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5243ea-0ab1-4e24-a057-e3aa3af22901', 'volume_name': 'volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8bffca-04f6-4ef1-be03-df3f78983334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab8bffca-04f6-4ef1-be03-df3f78983334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ef7905-72b9-4eb5-9bfa-0bb0f26ff92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume ed5243ea-0ab1-4e24-a057-e3aa3af22901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901', 'volume_size': 1}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-a62002d6-9b7f-49a8-9f52-1ce907f1cec8" released by "delete_volume" :: held 2.889s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (bdba9c21-126b-48a3-9f16-ef8f48f38d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e948311e-86ac-4f3b-bcb2-78cd13039474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709 1073741824" returned: 0 in 1.103s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:41 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (b9708a54-ef95-42cc-b541-a4a5345e00a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26761e8-69a8-4685-a9b8-dde77693b731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e948311e-86ac-4f3b-bcb2-78cd13039474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701365529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9eab78-5bb0-46b0-bb30-30fc45fc7fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:40Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0143394e-67c0-41fe-980d-cd4140522faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0143394e-67c0-41fe-980d-cd4140522faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3b585f-4542-4d91-a60a-0aa2a5e90923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3b585f-4542-4d91-a60a-0aa2a5e90923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9eab78-5bb0-46b0-bb30-30fc45fc7fea', 'volume_name': 'volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769f9563-bf4c-4ee3-9b15-1d6f088b4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769f9563-bf4c-4ee3-9b15-1d6f088b4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730dbd42-1265-4d66-8748-8c37bd05ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume 4c9eab78-5bb0-46b0-bb30-30fc45fc7fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea', 'volume_size': 1}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709" returned: 0 in 0.655s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:42 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (4a12bdb2-8cad-4006-8524-00251c01497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed82db3-89cb-4050-b177-3ed89cd4426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (1888ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a26761e8-69a8-4685-a9b8-dde77693b731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192849302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc3de6e-e56f-414e-8bc4-d91b794431a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:41Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3106392f-3e7f-4b41-9e3b-bc4bc15d6add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3106392f-3e7f-4b41-9e3b-bc4bc15d6add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6515c2e5-d8ce-4f03-bc5e-f881b129ea37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6515c2e5-d8ce-4f03-bc5e-f881b129ea37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc3de6e-e56f-414e-8bc4-d91b794431a2', 'volume_name': 'volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6569c1a5-2199-44be-a83e-b6b820fb2569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6569c1a5-2199-44be-a83e-b6b820fb2569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367015ed-032e-4c29-ad8c-30853be4d832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume 8bc3de6e-e56f-414e-8bc4-d91b794431a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2', 'volume_size': 1}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192849302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc3de6e-e56f-414e-8bc4-d91b794431a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:41Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume 8bc3de6e-e56f-414e-8bc4-d91b794431a2 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:42 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:42 devstack quobyte-client[82905]: System call of process 100338 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:42 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=155, name=volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74794bca-ea54-4867-979f-7422281c6d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e801a69-90fd-423f-bcfd-e192f0953709', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cec2378-37ed-49a6-abc1-4d23c099bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed82db3-89cb-4050-b177-3ed89cd4426c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663817667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399ddfd3-51b2-40b1-b8c3-bb310026f8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:42Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3dc71-cbc9-4747-8db3-aa52ead7863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb3dc71-cbc9-4747-8db3-aa52ead7863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5eebc99-bff1-4d68-b815-b36759e5cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5eebc99-bff1-4d68-b815-b36759e5cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399ddfd3-51b2-40b1-b8c3-bb310026f8a2', 'volume_name': 'volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf385c8-fd91-4f64-8a9b-1d096e570f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf385c8-fd91-4f64-8a9b-1d096e570f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad2b43-0152-4d62-8909-b116b9297746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:43 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume 399ddfd3-51b2-40b1-b8c3-bb310026f8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2', 'volume_size': 1}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:43 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-9e801a69-90fd-423f-bcfd-e192f0953709 (9e801a69-90fd-423f-bcfd-e192f0953709): created successfully
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cec2378-37ed-49a6-abc1-4d23c099bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (cf0870d4-ed1d-4792-969c-c6ec5827200b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 1073741824" returned: 0 in 0.713s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-53597d41-f218-4073-992c-c912cb78cdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2" returned: 0 in 0.397s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (1151ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701365529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9eab78-5bb0-46b0-bb30-30fc45fc7fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:40Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume 4c9eab78-5bb0-46b0-bb30-30fc45fc7fea {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:43 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:43 devstack quobyte-client[82905]: System call of process 100342 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:43 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=156, name=volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Created reservations ['045fda97-712f-443e-b9f2-a77ad899555a', '58e6e729-1d8d-4d58-ad9e-90ebe614bcaa', 'bc5254d5-6534-4d51-b85b-c1621f14944e', 'bba426be-1b82-471a-9a05-7432f3c7fa7f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367015ed-032e-4c29-ad8c-30853be4d832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9451e95-c82a-46bb-8b00-1c047fd2dcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea 1073741824" returned: 0 in 0.640s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:44 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 (8bc3de6e-e56f-414e-8bc4-d91b794431a2): created successfully
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9451e95-c82a-46bb-8b00-1c047fd2dcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (b9708a54-ef95-42cc-b541-a4a5345e00a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" returned: 0 in 0.380s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (1056ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-863783639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5243ea-0ab1-4e24-a057-e3aa3af22901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:39Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume ed5243ea-0ab1-4e24-a057-e3aa3af22901 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:44 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:44 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:45 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=157, name=volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:45 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a117f664-d036-42b3-bb71-4e12bbd6d770 tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (730dbd42-1265-4d66-8748-8c37bd05ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c77d3cb-0783-4ebd-bc8c-7540e8561a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 1073741824" returned: 0 in 0.593s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:45 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea (4c9eab78-5bb0-46b0-bb30-30fc45fc7fea): created successfully
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c77d3cb-0783-4ebd-bc8c-7540e8561a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (bdba9c21-126b-48a3-9f16-ef8f48f38d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-036c48c7-37d2-4f0c-88fa-589cf422e552-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901" returned: 0 in 0.578s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (1197ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.819s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:45 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1663817667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399ddfd3-51b2-40b1-b8c3-bb310026f8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0ea05aa73447679e0779b68217626b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:52:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:52:42Z,use_quota=True,user_id='93772f2dda1c470495004ab5ebcddd45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Creating volume 399ddfd3-51b2-40b1-b8c3-bb310026f8a2 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:52:46 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:46 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f6ecfd80-8749-40ba-9d20-22836f4c2dba tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:46 devstack quobyte-client[82905]: System call of process 100352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:46 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=158, name=volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-036c48c7-37d2-4f0c-88fa-589cf422e552-delete_volume" acquired by "delete_volume" :: waited 0.854s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ef7905-72b9-4eb5-9bfa-0bb0f26ff92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:46 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113c24a2-d7e8-4f8e-99af-8508c7520574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 1073741824" returned: 0 in 0.996s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:47 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 (ed5243ea-0ab1-4e24-a057-e3aa3af22901): created successfully
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113c24a2-d7e8-4f8e-99af-8508c7520574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (53bf6170-6c97-40de-8a36-3002bc6c081a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.899s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Deleted volume successfully.
Sep 10 19:52:47 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-quobyte-036c48c7-37d2-4f0c-88fa-589cf422e552" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" returned: 0 in 0.731s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] <== create_volume: return (1752ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:47 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c522335c-7017-4264-9678-9dfcfb87fdae tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ad2b43-0152-4d62-8909-b116b9297746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e8084-a4fe-4619-afe9-78988147a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ac5e895d-5230-492c-adfa-5a979703399f tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-a62002d6-9b7f-49a8-9f52-1ce907f1cec8-delete_volume" released by "delete_volume" :: held 9.515s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-036c48c7-37d2-4f0c-88fa-589cf422e552" acquired by "delete_volume" :: waited 0.231s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:47 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 (399ddfd3-51b2-40b1-b8c3-bb310026f8a2): created successfully
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36e8084-a4fe-4619-afe9-78988147a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Flow 'volume_create_manager' (4a12bdb2-8cad-4006-8524-00251c01497c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5097acb1-cb45-478b-b689-a61df2e12bb1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9ce07ac0-38b4-4400-a25e-add2ad0a340d tempest-CreateVolumesFromSnapshotTest-291541667 None] Created volume successfully.
Sep 10 19:52:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552" returned: 0 in 0.563s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-036c48c7-37d2-4f0c-88fa-589cf422e552" returned: 0 in 0.104s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-036c48c7-37d2-4f0c-88fa-589cf422e552" released by "delete_volume" :: held 0.917s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-399ddfd3-51b2-40b1-b8c3-bb310026f8a2-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-399ddfd3-51b2-40b1-b8c3-bb310026f8a2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Created reservations ['87e417b3-bddc-4d71-b9af-1d094a2c4ea5', '910e5d7e-f121-489e-ab29-0188835bbd96', '05eb94cc-110b-4c17-ac61-26ad23443658', 'ad5030fb-bd68-4ba0-8b82-c2556a0ae920'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" acquired by "delete_volume" :: waited 0.039s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[381d911e-9aad-4d30-b3b9-62f292b42b87]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:50 devstack quobyte-client[82905]: System call of process 100361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.195s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:50 devstack quobyte-client[82905]: System call of process 100361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-19ffcc0d-88d4-4560-9b17-5c298d47fbdb-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:50 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Deleted volume successfully.
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" returned: 0 in 1.320s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-19ffcc0d-88d4-4560-9b17-5c298d47fbdb-delete_volume" acquired by "delete_volume" :: waited 0.480s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5325f7-1e7c-4da8-9bb7-a63b6fa28f1a tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-036c48c7-37d2-4f0c-88fa-589cf422e552-delete_volume" released by "delete_volume" :: held 4.687s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" returned: 0 in 0.643s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-399ddfd3-51b2-40b1-b8c3-bb310026f8a2" released by "delete_volume" :: held 2.088s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:51 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-quobyte-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" acquired by "delete_volume" :: waited 0.037s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a93b49-f52d-4115-9566-d1b071447a76]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:52 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['a21bb8c8-d8e1-4b56-aede-cef7fb851f78', '0f76a0fe-284b-4856-acd0-a1b88ec3ed4d', '651b5c44-a4ca-4c01-b778-47968f9bff29', '10345fba-a7a3-4a5b-a492-a4f92fe2a52e'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" returned: 0 in 0.941s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-8bc3de6e-e56f-414e-8bc4-d91b794431a2-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" returned: 0 in 0.304s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-8bc3de6e-e56f-414e-8bc4-d91b794431a2-delete_volume" acquired by "delete_volume" :: waited 0.390s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-19ffcc0d-88d4-4560-9b17-5c298d47fbdb" released by "delete_volume" :: held 1.554s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:53 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-8bc3de6e-e56f-414e-8bc4-d91b794431a2" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-8bc3de6e-e56f-414e-8bc4-d91b794431a2" acquired by "delete_volume" :: waited 0.096s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa340cbb-bf5e-43b7-a26f-8b9ac6d7d88d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e8d3d2cb-eae4-409a-aaf3-3bac1464a08d tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-399ddfd3-51b2-40b1-b8c3-bb310026f8a2-delete_volume" released by "delete_volume" :: held 5.210s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Created reservations ['8cc822e4-fff0-42e9-9f83-6803b2126a8d', '14a9eb32-ccfb-4f2c-8146-e1920f110131', '84d18fb4-9e19-4dab-af25-d5e5c58c6e3d', '0b38084b-71a9-4e7b-aa84-c9ac0e857fea'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2" returned: 0 in 0.852s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.442s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-74a02faf-f91e-4a01-a014-1769e1cdc442-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:55 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Deleted volume successfully.
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-8bc3de6e-e56f-414e-8bc4-d91b794431a2" returned: 0 in 0.559s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-74a02faf-f91e-4a01-a014-1769e1cdc442-delete_volume" acquired by "delete_volume" :: waited 0.264s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-31c3e6ee-aac6-481a-8dc0-798687d7f9eb tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-19ffcc0d-88d4-4560-9b17-5c298d47fbdb-delete_volume" released by "delete_volume" :: held 4.555s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-8bc3de6e-e56f-414e-8bc4-d91b794431a2" released by "delete_volume" :: held 1.586s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "cinder-quobyte-74a02faf-f91e-4a01-a014-1769e1cdc442" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-74a02faf-f91e-4a01-a014-1769e1cdc442" acquired by "delete_volume" :: waited 0.068s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['8f160086-9ed7-41f7-8953-85f722970dd4', '476fa40b-a911-4ee1-a434-f710b36faf0a', 'a71ed266-f9ed-4a52-990e-c28b2da372d9', '7d5844c7-12b2-4bed-8e8c-088d0b3b3a77'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef349bf-1380-4718-aa70-96e1eba854ae]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442" returned: 0 in 1.154s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" acquired by "delete_volume" :: waited 0.431s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.477s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[48445265-d27e-444a-af60-3bd5db07879a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-74a02faf-f91e-4a01-a014-1769e1cdc442" returned: 0 in 0.469s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-quobyte-74a02faf-f91e-4a01-a014-1769e1cdc442" released by "delete_volume" :: held 1.985s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5f3233a3-3f2d-444e-8939-f040710aff13 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-8bc3de6e-e56f-414e-8bc4-d91b794431a2-delete_volume" released by "delete_volume" :: held 4.730s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Created reservations ['2b358db1-a813-4ffd-872f-007bc116a2c9', 'b8c6479e-ef3c-4dbd-a520-28bd53eb1175', '33df9922-c575-488a-b193-878708bdbffd', '5b0522e2-e8fe-4326-a85c-4ec450283ff2'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" returned: 0 in 0.898s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.205s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:58 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Deleted volume successfully.
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" returned: 0 in 0.413s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea" released by "delete_volume" :: held 1.697s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-5617e13d-67e3-4cb7-a93e-c3791a68749e tempest-CreateVolumesFromImageTest-127842520 None] Lock "cinder-74a02faf-f91e-4a01-a014-1769e1cdc442-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['7b4e0c98-4d92-4205-ac04-80fd856e0f6a', '32993aa6-84a5-44c8-aee9-fccca82fb1cc', 'a14faa24-c1a8-4fb3-801a-0c50817473e3', '2dbb2977-667a-492e-b545-6ede8f2e941d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.215s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:52:59 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:52:59 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-9f0487b6-c56e-4cf7-927b-d3302c4b368e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-4c9eab78-5bb0-46b0-bb30-30fc45fc7fea-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-ed5243ea-0ab1-4e24-a057-e3aa3af22901-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-ed5243ea-0ab1-4e24-a057-e3aa3af22901-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:00 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-ed5243ea-0ab1-4e24-a057-e3aa3af22901" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-ed5243ea-0ab1-4e24-a057-e3aa3af22901" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7d6216-a0eb-479a-96c4-c2f622c395d1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:01 devstack quobyte-client[82905]: System call of process 100426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901" returned: 0 in 0.570s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ed5243ea-0ab1-4e24-a057-e3aa3af22901" returned: 0 in 0.204s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-ed5243ea-0ab1-4e24-a057-e3aa3af22901" released by "delete_volume" :: held 1.248s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:01 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:01 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Flow 'volume_create_manager' (f209cc29-2a7b-479f-a2fc-cdb3cc02591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d5a0a4-4fd4-4f40-9448-39c45b92b0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d5a0a4-4fd4-4f40-9448-39c45b92b0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223014026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0973b0-a674-4226-ad30-436ca618542d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce11bad586f452f86f9fffa2fbc053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:01Z,use_quota=True,user_id='167502c334814959ac9afe4787bede64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289251d-a5a4-437c-95e6-2404258aa4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2289251d-a5a4-437c-95e6-2404258aa4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad6a276-00f6-4567-b123-a550a5e6e16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad6a276-00f6-4567-b123-a550a5e6e16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0973b0-a674-4226-ad30-436ca618542d', 'volume_name': 'volume-dc0973b0-a674-4226-ad30-436ca618542d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c595089-e107-45e3-b406-3403a024670a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c595089-e107-45e3-b406-3403a024670a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aeb6d3b-0635-4a1e-b828-716f94b137f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:02 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Volume dc0973b0-a674-4226-ad30-436ca618542d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0973b0-a674-4226-ad30-436ca618542d', 'volume_size': 1}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-223014026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0973b0-a674-4226-ad30-436ca618542d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce11bad586f452f86f9fffa2fbc053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:01Z,use_quota=True,user_id='167502c334814959ac9afe4787bede64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Creating volume dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:02 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:02 devstack quobyte-client[82905]: System call of process 100431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:02 devstack quobyte-client[82905]: System call of process 100431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:02 devstack quobyte-client[82905]: System call of process 100431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:02 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=159, name=volume-dc0973b0-a674-4226-ad30-436ca618542d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['b1658879-00b8-4df0-868c-3e126ebc2da6', '5f8ed46a-9063-474c-b5ad-684a27f19546', '4c7f5908-ef79-4e9a-a2fa-18e6adc9fbfd', 'c4540d55-05be-40d5-bd99-6d7f8708d40f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d 1073741824" returned: 0 in 0.545s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.259s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] <== create_volume: return (843ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aeb6d3b-0635-4a1e-b828-716f94b137f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0973b0-a674-4226-ad30-436ca618542d', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067d1a0e-e105-4bc0-9afd-32ea7a61a314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:03 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Volume volume-dc0973b0-a674-4226-ad30-436ca618542d (dc0973b0-a674-4226-ad30-436ca618542d): created successfully
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067d1a0e-e105-4bc0-9afd-32ea7a61a314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Flow 'volume_create_manager' (f209cc29-2a7b-479f-a2fc-cdb3cc02591e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-dd6ed53c-121d-4528-b043-bf3287a30ce4 tempest-SnapshotDependencyTests-909670588 None] Created volume successfully.
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.129s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:03 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:53:03 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-d4a7edfa-b76f-4e4f-988a-88fbf476293e tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-ed5243ea-0ab1-4e24-a057-e3aa3af22901-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-9e801a69-90fd-423f-bcfd-e192f0953709-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-9e801a69-90fd-423f-bcfd-e192f0953709-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-9e801a69-90fd-423f-bcfd-e192f0953709" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-9e801a69-90fd-423f-bcfd-e192f0953709" acquired by "delete_volume" :: waited 0.047s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[944b7d64-c04f-4f55-b559-5dd5b9328fc5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:04 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Creating offline snapshot 40000cec-7663-485c-b719-c6dd55d9848f of volume dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d5a58b-2867-4249-b604-74c361b83ed7]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709" returned: 0 in 0.823s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-9e801a69-90fd-423f-bcfd-e192f0953709" returned: 0 in 0.172s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-9e801a69-90fd-423f-bcfd-e192f0953709" released by "delete_volume" :: held 1.233s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.805s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:05 devstack quobyte-client[82905]: System call of process 100443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:05 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=160, name=volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f 1G" returned: 0 in 0.374s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): qemu-img rebase -u -b volume-dc0973b0-a674-4226-ad30-436ca618542d -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:06 devstack quobyte-client[82905]: System call of process 100446 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "qemu-img rebase -u -b volume-dc0973b0-a674-4226-ad30-436ca618542d -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.227s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['dd95fc11-ebb7-4d0f-92d4-d65e1825c667', '79720550-d21d-4f06-9c15-b38b7b7b6819', 'ea6ae104-8369-4f9a-856b-493d61f5600d', 'dc016c12-4bfe-4ea3-8c1a-843278153cf1'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.327s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.272s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.info" returned: 0 in 0.217s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.info" returned: 0 in 0.245s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.758s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:07 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a82df28a-479d-4202-b871-7a83378c2692 tempest-SnapshotDependencyTests-909670588 None] Create snapshot completed successfully
Sep 10 19:53:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Flow 'volume_create_manager' (4d3d3a10-bcf8-4fc2-b405-c93460ec4cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2e5955-71ba-439a-83b8-9d4db3e0ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.664s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:08 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2e5955-71ba-439a-83b8-9d4db3e0ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204c02aa-aa91-4530-87be-4ec9ac6684bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfcbde797693455aa66bcdb186e0d7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:08Z,use_quota=True,user_id='06165118ca924aeebbde6b233b4649af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc48e3-4e8d-44bc-a500-074cc015ded3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc48e3-4e8d-44bc-a500-074cc015ded3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc13aa0-5cc3-4f23-b6ec-beab32aed3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-a97675fd-a4ff-4a0f-ab37-f64364af3a76 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-9e801a69-90fd-423f-bcfd-e192f0953709-delete_volume" released by "delete_volume" :: held 4.679s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:08 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleting offline snapshot c7747fb9-d0a8-499d-b7bc-1288cf9bb97b of volume 0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] snapshot_file for this snap is: volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4ed67-c49a-4a38-89eb-a3b7f2abbf82]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc13aa0-5cc3-4f23-b6ec-beab32aed3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '204c02aa-aa91-4530-87be-4ec9ac6684bd', 'volume_name': 'volume-204c02aa-aa91-4530-87be-4ec9ac6684bd', 'volume_size': 1, 'image_id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e1e60a2779e0f63d023626dd326f3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfcbde797693455aa66bcdb186e0d7bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'deb42b2ca410cfdb53fcea307e49497c1d1dd52e460df11a95dbbf7bc4fd1cbf49c424e7bcacf18a7c8a795dfa681b1d596bed495b2cf45e1922452a490ad10f', 'id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1ef9e0-2885-4d5c-85f9-805842ff38ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0cefabc0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7a89c-5e00-4d5c-b763-5d80fd0df00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7a89c-5e00-4d5c-b763-5d80fd0df00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3166bc0d-2a2b-486d-a7ef-8fa4f2dbad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:09 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Volume 204c02aa-aa91-4530-87be-4ec9ac6684bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-204c02aa-aa91-4530-87be-4ec9ac6684bd', 'volume_size': 1, 'image_id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e1e60a2779e0f63d023626dd326f3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfcbde797693455aa66bcdb186e0d7bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'deb42b2ca410cfdb53fcea307e49497c1d1dd52e460df11a95dbbf7bc4fd1cbf49c424e7bcacf18a7c8a795dfa681b1d596bed495b2cf45e1922452a490ad10f', 'id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1ef9e0-2885-4d5c-85f9-805842ff38ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0cefabc0>}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Cloning 204c02aa-aa91-4530-87be-4ec9ac6684bd from image af1ef9e0-2885-4d5c-85f9-805842ff38ec  at location (None, None). {{(pid=82863) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.612s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0578d700-8e0f-49ad-a183-539ee1cab0b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[901afff5-54e9-4811-b510-a32b589796c8]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:09 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 10 19:53:09 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Image download 0.00 MB at 0.00 MB/s
Sep 10 19:53:10 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff9f75-83af-4708-97b7-dc1f0f922e7c]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4" returned: 0 in 0.784s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Flow 'volume_create_manager' (58429bbf-1c01-49c1-bfa6-171962fe8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:10 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85a263-152c-4f62-a52a-69663546c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:10 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD
Sep 10 19:53:10 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85a263-152c-4f62-a52a-69663546c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b703eace-1e38-4bc3-b49b-590ebecc3e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ce11bad586f452f86f9fffa2fbc053e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40000cec-7663-485c-b719-c6dd55d9848f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:09Z,use_quota=True,user_id='167502c334814959ac9afe4787bede64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34554421-7e0d-4e03-bd6d-e178e9433225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34554421-7e0d-4e03-bd6d-e178e9433225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30019329-eafd-4876-8bca-ce88f086c64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30019329-eafd-4876-8bca-ce88f086c64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b703eace-1e38-4bc3-b49b-590ebecc3e7d', 'volume_name': 'volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d', 'volume_size': 1, 'snapshot_id': '40000cec-7663-485c-b719-c6dd55d9848f'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60617934-37f0-4d10-a2a9-fc78616b1a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60617934-37f0-4d10-a2a9-fc78616b1a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1bf0b9-816b-4770-a9aa-b711278d5c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:11 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Volume b703eace-1e38-4bc3-b49b-590ebecc3e7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d', 'volume_size': 1, 'snapshot_id': '40000cec-7663-485c-b719-c6dd55d9848f'}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.706s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.024s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f-b703eace-1e38-4bc3-b49b-590ebecc3e7d" by "_create_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4.c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" returned: 0 in 0.335s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f-b703eace-1e38-4bc3-b49b-590ebecc3e7d" acquired by "_create_volume_from_snapshot" :: waited 0.109s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Creating volume b703eace-1e38-4bc3-b49b-590ebecc3e7d from snapshot 40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" by "_copy_volume_from_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b" released by "_delete_snapshot" :: held 2.819s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" released by "delete_snapshot" :: held 2.858s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" acquired by "_copy_volume_from_snapshot" :: waited 0.245s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] snapshot: 40000cec-7663-485c-b719-c6dd55d9848f, volume: b703eace-1e38-4bc3-b49b-590ebecc3e7d,  {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[135870e8-1596-4bcd-9a9b-de7a4772745d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['9c2c9c45-09ae-4f50-96bd-90f60bed8f4f', 'debad094-d0f5-4803-884f-df2cd0be5320', 'a1e3abd2-3eba-43d5-aedc-c9e2a8874a9a', '9303a8f3-f937-4df3-ac33-6faad74618ea'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:12 devstack quobyte-client[82905]: System call of process 100467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:12 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Delete snapshot completed successfully.
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.926s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0973b0-a674-4226-ad30-436ca618542d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Creating direct copy from snapshot {{(pid=82863) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f0dc7b19-a49f-44ec-80ed-d73d6c1c9752 tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-c7747fb9-d0a8-499d-b7bc-1288cf9bb97b-delete_snapshot" released by "delete_snapshot" :: held 4.198s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[3188a7a2-f10d-4802-8639-b9f7393433b5]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-0578d700-8e0f-49ad-a183-539ee1cab0b4-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:13 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 0 in 3.271s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-0578d700-8e0f-49ad-a183-539ee1cab0b4-delete_volume" acquired by "delete_volume" :: waited 0.299s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:13 devstack quobyte-client[82905]: System call of process 100473 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.984s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG cinder.utils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d not found in is_blk_device check {{(pid=82863) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 10 19:53:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:14 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD
Sep 10 19:53:14 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:14 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=162, name=volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:14 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:14 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" acquired by "delete_volume" :: waited 0.078s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:14 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ff424d-6098-4af2-9c6c-6d3638a8e00b]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:14 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4" returned: 0 in 2.579s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:17 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:18 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-0578d700-8e0f-49ad-a183-539ee1cab0b4" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:18 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-quobyte-0578d700-8e0f-49ad-a183-539ee1cab0b4" released by "delete_volume" :: held 4.440s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:20 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Created reservations ['58695341-bac3-49cd-9a9b-8cb787e78786', '47d965e8-e23f-471d-9384-138976a85005', 'a8672a37-9c7d-4611-a787-8dcb9c6b85c2', '821d19d9-566a-452f-9d2c-53f4ad178b17'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:20 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 1 in 7.399s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:20 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:20 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Temporary image af1ef9e0-2885-4d5c-85f9-805842ff38ec is fetched for user 06165118ca924aeebbde6b233b4649af. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:21 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d" returned: 0 in 8.576s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.317s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[982dc0b9-d9cc-44a4-b8f5-b3df6a5f4abc]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:22 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68084c9-fbe5-4e8a-828b-1c3be143e831]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:23 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Deleted volume successfully.
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-e0e504d3-8ec2-430b-8835-32617311664f tempest-CreateVolumesFromSnapshotTest-291541667 None] Lock "cinder-0578d700-8e0f-49ad-a183-539ee1cab0b4-delete_volume" released by "delete_volume" :: held 10.115s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 1.248s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Image conversion details: src /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:53:23 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Converted 1024.00 MB image at 118.90 MB/s
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:53:23 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:24 devstack sudo[100500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD
Sep 10 19:53:24 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d" returned: 0 in 0.239s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" released by "_copy_volume_from_snapshot" :: held 12.632s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f-b703eace-1e38-4bc3-b49b-590ebecc3e7d" released by "_create_volume_from_snapshot" :: held 12.923s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.050s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=74,cinder:UPDATE=127,cinder:DELETE=12,cinder:INSERT=19 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:24 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=115,cinder:SELECT=84,cinder:DELETE=13,cinder:INSERT=30 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:53:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1bf0b9-816b-4770-a9aa-b711278d5c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d', 'volume_size': 1, 'snapshot_id': '40000cec-7663-485c-b719-c6dd55d9848f'}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c36d877-cf47-4503-857a-549cf5f7f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:25 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Volume volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d (b703eace-1e38-4bc3-b49b-590ebecc3e7d): created successfully
Sep 10 19:53:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c36d877-cf47-4503-857a-549cf5f7f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:25 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Flow 'volume_create_manager' (58429bbf-1c01-49c1-bfa6-171962fe8191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:25 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-7e5fb6c9-8ae9-489d-b42d-843112137ae3 tempest-SnapshotDependencyTests-909670588 None] Created volume successfully.
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-40000cec-7663-485c-b719-c6dd55d9848f-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-40000cec-7663-485c-b719-c6dd55d9848f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:26 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Deleting offline snapshot 40000cec-7663-485c-b719-c6dd55d9848f of volume dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] snapshot_file for this snap is: volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7111b1-97f0-47f6-b0ed-269efadff89e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:26 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 0 in 3.447s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:26 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:27 devstack quobyte-client[82905]: System call of process 100507 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.643s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc0973b0-a674-4226-ad30-436ca618542d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb5302-e525-4780-9443-b23625f2e83e]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:27 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD
Sep 10 19:53:27 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.569s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:27 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.298s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:28 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d.40000cec-7663-485c-b719-c6dd55d9848f" returned: 0 in 0.142s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-40000cec-7663-485c-b719-c6dd55d9848f" released by "_delete_snapshot" :: held 2.154s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:28 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" released by "delete_snapshot" :: held 2.206s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:29 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (e9c5e2dd-446e-41bc-8a56-7d9f79aefecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b0c440-9d6f-4432-89b4-d3ec66b5e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b0c440-9d6f-4432-89b4-d3ec66b5e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74053963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7a861-7f54-4086-97b6-334e2bfc8c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:29Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504e6d16-0060-41ea-8364-93b8eee16592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504e6d16-0060-41ea-8364-93b8eee16592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c6c74c-60a2-43bf-8c75-0137a47bd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c6c74c-60a2-43bf-8c75-0137a47bd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd7a861-7f54-4086-97b6-334e2bfc8c8f', 'volume_name': 'volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd88b4-83d1-41ec-9094-501d8438661a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebdd88b4-83d1-41ec-9094-501d8438661a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffd9be7-5f6d-4094-a3fb-16d1d1741b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:29 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume 4cd7a861-7f54-4086-97b6-334e2bfc8c8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f', 'volume_size': 1}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74053963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7a861-7f54-4086-97b6-334e2bfc8c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:29Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume 4cd7a861-7f54-4086-97b6-334e2bfc8c8f {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:29 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:29 devstack quobyte-client[82905]: System call of process 100522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:29 devstack quobyte-client[82905]: System call of process 100522 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:29 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=163, name=volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:29 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Created reservations ['d0f6e9a6-7f30-4d3b-9493-0e70acc91b67', 'b98e9136-eda4-4951-b346-f548fbfb7cf1', '854a1744-4122-4961-8000-0d3fcabd9f9e', '53cfc189-9d6c-4eaf-a5ad-54d776d9a035'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:29 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 1 in 3.302s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f 1073741824" returned: 0 in 0.578s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" returned: 0 in 0.138s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (781ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.275s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204c02aa-aa91-4530-87be-4ec9ac6684bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfcbde797693455aa66bcdb186e0d7bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:08Z,use_quota=True,user_id='06165118ca924aeebbde6b233b4649af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Creating volume 204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:30 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:30 devstack quobyte-client[82905]: System call of process 100526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:30 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=164, name=volume-204c02aa-aa91-4530-87be-4ec9ac6684bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bffd9be7-5f6d-4094-a3fb-16d1d1741b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e6441d-0ffe-4b37-937e-75217cb81156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-dc0973b0-a674-4226-ad30-436ca618542d-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:30 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f (4cd7a861-7f54-4086-97b6-334e2bfc8c8f): created successfully
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e6441d-0ffe-4b37-937e-75217cb81156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:30 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (e9c5e2dd-446e-41bc-8a56-7d9f79aefecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd 1073741824" returned: 0 in 0.666s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-dc0973b0-a674-4226-ad30-436ca618542d-delete_volume" acquired by "delete_volume" :: waited 0.298s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-9ad3800a-1c34-42f6-bf6b-3d724e05c85f tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 0 in 0.370s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] <== create_volume: return (1064ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:31 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Delete snapshot completed successfully.
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-4b2bf2a9-db01-4020-8231-bc68d7222ad2 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-40000cec-7663-485c-b719-c6dd55d9848f-delete_snapshot" released by "delete_snapshot" :: held 5.201s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:31 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Attempting download of af1ef9e0-2885-4d5c-85f9-805842ff38ec ((None, None)) to volume 204c02aa-aa91-4530-87be-4ec9ac6684bd. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" acquired by "delete_volume" :: waited 0.049s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb61917c-f405-4b71-9097-bef0e13964c2]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:31 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec48ebe5-64ab-469c-b28c-aa86154763be]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af1ef9e0-2885-4d5c-85f9-805842ff38ec_g0nydz6q {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.626s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-dc0973b0-a674-4226-ad30-436ca618542d" returned: 0 in 0.196s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:32 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-dc0973b0-a674-4226-ad30-436ca618542d" released by "delete_volume" :: held 1.320s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af1ef9e0-2885-4d5c-85f9-805842ff38ec_g0nydz6q" returned: 0 in 0.894s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1ef9e0-2885-4d5c-85f9-805842ff38ec_g0nydz6q {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:33 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (6fa67661-c4ba-43be-82ef-1c24236275eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0db7e0f-df24-4ab0-946c-4fcf3d892ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0db7e0f-df24-4ab0-946c-4fcf3d892ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899009332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced3cc67-ae63-42bd-9644-aae99b34c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:33Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3e1dfa-ef96-45fc-97b0-f29373b69065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce3e1dfa-ef96-45fc-97b0-f29373b69065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73933eb-006e-4fde-bd49-50a62f8650a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73933eb-006e-4fde-bd49-50a62f8650a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced3cc67-ae63-42bd-9644-aae99b34c5d5', 'volume_name': 'volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa545b4-767c-48b5-9c81-d5040bcf322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa545b4-767c-48b5-9c81-d5040bcf322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619d4e08-27d9-41cf-862d-9e48b8c8ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:33 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume ced3cc67-ae63-42bd-9644-aae99b34c5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5', 'volume_size': 1}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1899009332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced3cc67-ae63-42bd-9644-aae99b34c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:33Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume ced3cc67-ae63-42bd-9644-aae99b34c5d5 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:33 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:33 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:34 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=165, name=volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1ef9e0-2885-4d5c-85f9-805842ff38ec_g0nydz6q" returned: 1 in 1.333s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1ef9e0-2885-4d5c-85f9-805842ff38ec_g0nydz6q' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:34 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (d5821dd7-cc09-405b-8553-07d41d105c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ee3bb0-cb78-47aa-b269-ecd71a756abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b80cc2-bce0-4cb0-a4cf-a1def142ad8a]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:34 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Created reservations ['215a15ea-12a4-4ec1-b0b9-dce2e4aa9bfe', 'f0a1d998-d62a-47d6-9071-c0fc2b43dde4', 'f1e7657f-b272-4214-a63a-0e0f81fa1c32', '77e1d971-08a8-4051-9e89-e0b3fd05f792'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 1073741824" returned: 0 in 1.244s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (37ebadc1-e9e1-4907-be64-661bac496159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871a2ace-3ad8-4fef-80d3-78b47347b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ee3bb0-cb78-47aa-b269-ecd71a756abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992349966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923730d2-a0eb-415b-bbe7-7a8674562c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:33Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273e876c-7426-448b-af30-db76f66b9b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (273e876c-7426-448b-af30-db76f66b9b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a2f5d6-572d-49c6-996b-7497492287b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a2f5d6-572d-49c6-996b-7497492287b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923730d2-a0eb-415b-bbe7-7a8674562c70', 'volume_name': 'volume-923730d2-a0eb-415b-bbe7-7a8674562c70', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f4268f-dda5-4084-b484-bf02c2eae318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f4268f-dda5-4084-b484-bf02c2eae318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636e2701-06f8-408f-bc9b-a70eb5b014d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume 923730d2-a0eb-415b-bbe7-7a8674562c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923730d2-a0eb-415b-bbe7-7a8674562c70', 'volume_size': 1}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:35 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (d63a9910-b58f-482a-a4e8-3baa6b4b3181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54d9615-25f6-4fe1-b08d-358669a41777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871a2ace-3ad8-4fef-80d3-78b47347b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181627983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45827a1-6db0-4695-a8fb-9f34e87e3738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:34Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afc3011-ef9e-43cc-9e25-03e7c2023b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1afc3011-ef9e-43cc-9e25-03e7c2023b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a14f6-3e03-4831-9986-a6082d9c3322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52a14f6-3e03-4831-9986-a6082d9c3322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a45827a1-6db0-4695-a8fb-9f34e87e3738', 'volume_name': 'volume-a45827a1-6db0-4695-a8fb-9f34e87e3738', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102647ee-29d7-45db-a858-dbaffdcd4cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (102647ee-29d7-45db-a858-dbaffdcd4cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab553258-5a7d-483e-b3ee-5ce15d3b9f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:35 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume a45827a1-6db0-4695-a8fb-9f34e87e3738: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a45827a1-6db0-4695-a8fb-9f34e87e3738', 'volume_size': 1}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c54d9615-25f6-4fe1-b08d-358669a41777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-914098470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd419f6d-8787-44ce-8511-5177df04baf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:35Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:35 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab27e879-bd5e-4bb8-9fe3-9c76c3aba8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab27e879-bd5e-4bb8-9fe3-9c76c3aba8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415a2e41-9045-41d3-82b3-b65739438c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (415a2e41-9045-41d3-82b3-b65739438c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd419f6d-8787-44ce-8511-5177df04baf5', 'volume_name': 'volume-bd419f6d-8787-44ce-8511-5177df04baf5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7a0fa1-c652-4246-8b75-640106932570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a7a0fa1-c652-4246-8b75-640106932570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7567e2-9165-4222-8f37-54e7ee872baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:36 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume bd419f6d-8787-44ce-8511-5177df04baf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd419f6d-8787-44ce-8511-5177df04baf5', 'volume_size': 1}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5" returned: 0 in 0.809s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (2087ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 0 in 1.360s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-992349966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923730d2-a0eb-415b-bbe7-7a8674562c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:33Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume 923730d2-a0eb-415b-bbe7-7a8674562c70 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:36 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:36 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:36 devstack quobyte-client[82905]: System call of process 100545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:36 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=166, name=volume-923730d2-a0eb-415b-bbe7-7a8674562c70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (38dbc274-cf37-4b2c-9986-8b0186fc70a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d462961c-b38f-4876-beb2-6f27355a4183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:36 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-b703eace-1e38-4bc3-b49b-590ebecc3e7d-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d462961c-b38f-4876-beb2-6f27355a4183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1220651965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec51691c-6be2-481d-9309-e40890df09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:35Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153ce916-cf3b-41e2-8153-cf36806aa8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153ce916-cf3b-41e2-8153-cf36806aa8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb04fe-0acc-4dc8-b650-f8a2b349634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeb04fe-0acc-4dc8-b650-f8a2b349634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec51691c-6be2-481d-9309-e40890df09b0', 'volume_name': 'volume-ec51691c-6be2-481d-9309-e40890df09b0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b673a9-79a3-46cf-992a-ef81270f8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b673a9-79a3-46cf-992a-ef81270f8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3aebb2-c338-4f6a-8772-7c989c61e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume ec51691c-6be2-481d-9309-e40890df09b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec51691c-6be2-481d-9309-e40890df09b0', 'volume_size': 1}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619d4e08-27d9-41cf-862d-9e48b8c8ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f72d44-c8cf-4797-a840-53d90ea4b40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70 1073741824" returned: 0 in 1.093s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-b703eace-1e38-4bc3-b49b-590ebecc3e7d-delete_volume" acquired by "delete_volume" :: waited 0.404s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:37 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 (ced3cc67-ae63-42bd-9644-aae99b34c5d5): created successfully
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f72d44-c8cf-4797-a840-53d90ea4b40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (6fa67661-c4ba-43be-82ef-1c24236275eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD" returned: 1 in 1.240s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:37 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:38 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-cd6996fc-5b47-48f0-8858-21a1e41db5e9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] af1ef9e0-2885-4d5c-85f9-805842ff38ec was raw, converting to raw {{(pid=82863) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=164, name=volume-204c02aa-aa91-4530-87be-4ec9ac6684bd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70" returned: 0 in 1.414s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:38 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (2607ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.615s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.753s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1181627983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a45827a1-6db0-4695-a8fb-9f34e87e3738,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:34Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume a45827a1-6db0-4695-a8fb-9f34e87e3738 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:38 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:38 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=167, name=volume-a45827a1-6db0-4695-a8fb-9f34e87e3738, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636e2701-06f8-408f-bc9b-a70eb5b014d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923730d2-a0eb-415b-bbe7-7a8674562c70', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68edf98b-0e22-45ff-8867-cc61274769b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 0 in 0.959s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af1ef9e0-2885-4d5c-85f9-805842ff38ec_7k048m_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 10 19:53:39 devstack cinder-volume[82863]: INFO cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Converted 0.00 MB image at 0.00 MB/s
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.332s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 1.729s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" acquired by "delete_volume" :: waited 0.876s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726b536-0e88-4b79-9132-85ef29976a06]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:39 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Deleted volume successfully.
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:39 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-923730d2-a0eb-415b-bbe7-7a8674562c70 (923730d2-a0eb-415b-bbe7-7a8674562c70): created successfully
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68edf98b-0e22-45ff-8867-cc61274769b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (d5821dd7-cc09-405b-8553-07d41d105c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:39 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 1073741824" returned: 0 in 1.265s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:40 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-21508e47-360d-48e3-bbbb-7b7832eea343 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738" returned: 0 in 0.375s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd 1G" returned: 0 in 1.171s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (1680ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d" returned: 0 in 0.790s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-6c364fa0-57df-439e-a9ea-604aa1cfa909 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-dc0973b0-a674-4226-ad30-436ca618542d-delete_volume" released by "delete_volume" :: held 9.203s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-914098470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd419f6d-8787-44ce-8511-5177df04baf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:35Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume bd419f6d-8787-44ce-8511-5177df04baf5 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:40 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:40 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=168, name=volume-bd419f6d-8787-44ce-8511-5177df04baf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecdab2-acdc-40e9-8ac9-4cf5d75b5769]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab553258-5a7d-483e-b3ee-5ce15d3b9f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a45827a1-6db0-4695-a8fb-9f34e87e3738', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:40 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672ee686-8a69-4141-a991-99161c24ad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:41 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 (a45827a1-6db0-4695-a8fb-9f34e87e3738): created successfully
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672ee686-8a69-4141-a991-99161c24ad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (37ebadc1-e9e1-4907-be64-661bac496159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:41 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3bc3df78-11ee-4250-aaef-c579fa107168 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-b703eace-1e38-4bc3-b49b-590ebecc3e7d" returned: 0 in 0.894s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5 1073741824" returned: 0 in 0.985s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5" returned: 0 in 0.271s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (1348ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 0 in 0.882s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-quobyte-b703eace-1e38-4bc3-b49b-590ebecc3e7d" released by "delete_volume" :: held 2.418s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.887s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1220651965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec51691c-6be2-481d-9309-e40890df09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1107f5dffa9483b86cd606974f9105d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:35Z,use_quota=True,user_id='2060ed2a6b7d45679fe23f43b42ef8c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:41 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Creating volume ec51691c-6be2-481d-9309-e40890df09b0 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:42 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:42 devstack quobyte-client[82905]: System call of process 100575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:42 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=169, name=volume-ec51691c-6be2-481d-9309-e40890df09b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7567e2-9165-4222-8f37-54e7ee872baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd419f6d-8787-44ce-8511-5177df04baf5', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06b1b07-be02-457c-9b16-8e51090927d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0 1073741824" returned: 0 in 0.701s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:42 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:42 devstack quobyte-client[82905]: System call of process 100576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:42 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-bd419f6d-8787-44ce-8511-5177df04baf5 (bd419f6d-8787-44ce-8511-5177df04baf5): created successfully
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06b1b07-be02-457c-9b16-8e51090927d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (d63a9910-b58f-482a-a4e8-3baa6b4b3181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0" returned: 0 in 0.433s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 1 in 1.045s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-d6783488-2d46-4e1f-93de-28921defcf12 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] <== create_volume: return (1180ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Downloaded image af1ef9e0-2885-4d5c-85f9-805842ff38ec ((None, None)) to volume 204c02aa-aa91-4530-87be-4ec9ac6684bd successfully. {{(pid=82863) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.image.image_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Temporary image af1ef9e0-2885-4d5c-85f9-805842ff38ec for user 06165118ca924aeebbde6b233b4649af is deleted. {{(pid=82863) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.volume_utils [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Marking volume 204c02aa-aa91-4530-87be-4ec9ac6684bd as bootable. {{(pid=82863) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Copying metadata from image af1ef9e0-2885-4d5c-85f9-805842ff38ec to 204c02aa-aa91-4530-87be-4ec9ac6684bd. {{(pid=82863) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Creating volume glance metadata for volume 204c02aa-aa91-4530-87be-4ec9ac6684bd backed by image af1ef9e0-2885-4d5c-85f9-805842ff38ec with: {'image_id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '75e1e60a2779e0f63d023626dd326f3a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82863) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c3aebb2-c338-4f6a-8772-7c989c61e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec51691c-6be2-481d-9309-e40890df09b0', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e8b07-bc85-421a-949a-a737a1051903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Created reservations ['2f0a2cfd-9ad1-4b8b-a6fd-2252bfed1e3d', 'bf3d87c1-9fdc-4d3c-8d1c-7591133c4cbd', '9a116f6c-3d31-4d06-9123-1386f2bc0cd7', '60cda4c6-5b27-4574-9dd0-83f13c5c99f6'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:43 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume volume-ec51691c-6be2-481d-9309-e40890df09b0 (ec51691c-6be2-481d-9309-e40890df09b0): created successfully
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a25e8b07-bc85-421a-949a-a737a1051903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Flow 'volume_create_manager' (38dbc274-cf37-4b2c-9986-8b0186fc70a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:43 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-aa9b01ec-438d-410f-8193-9b33adefc180 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created volume successfully.
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3166bc0d-2a2b-486d-a7ef-8fa4f2dbad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204c02aa-aa91-4530-87be-4ec9ac6684bd', 'volume_size': 1, 'image_id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '75e1e60a2779e0f63d023626dd326f3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cfcbde797693455aa66bcdb186e0d7bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'deb42b2ca410cfdb53fcea307e49497c1d1dd52e460df11a95dbbf7bc4fd1cbf49c424e7bcacf18a7c8a795dfa681b1d596bed495b2cf45e1922452a490ad10f', 'id': 'af1ef9e0-2885-4d5c-85f9-805842ff38ec', 'created_at': datetime.datetime(2025, 9, 10, 17, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 17, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1ef9e0-2885-4d5c-85f9-805842ff38ec/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f7c0cefabc0>}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fdb39b-9f25-4d47-b919-c536e7f2be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:43 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Volume volume-204c02aa-aa91-4530-87be-4ec9ac6684bd (204c02aa-aa91-4530-87be-4ec9ac6684bd): created successfully
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4fdb39b-9f25-4d47-b919-c536e7f2be88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Flow 'volume_create_manager' (4d3d3a10-bcf8-4fc2-b405-c93460ec4cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.351s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:43 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:44 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-eb4df9ac-c984-4854-a232-e99829e488f9 tempest-VolumeImageDependencyTests-2143163171 None] Created volume successfully.
Sep 10 19:53:44 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Deleted volume successfully.
Sep 10 19:53:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-f6d9d5db-9e43-4d7c-aaf4-2387162c4056 tempest-SnapshotDependencyTests-909670588 None] Lock "cinder-b703eace-1e38-4bc3-b49b-590ebecc3e7d-delete_volume" released by "delete_volume" :: held 6.836s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-ec51691c-6be2-481d-9309-e40890df09b0-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-ec51691c-6be2-481d-9309-e40890df09b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:44 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Acquiring lock "cinder-204c02aa-aa91-4530-87be-4ec9ac6684bd-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-ec51691c-6be2-481d-9309-e40890df09b0" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "cinder-204c02aa-aa91-4530-87be-4ec9ac6684bd-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-ec51691c-6be2-481d-9309-e40890df09b0" acquired by "delete_volume" :: waited 0.055s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce13d2-913d-43b5-b36a-d4251e2aca2c]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:45 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Acquiring lock "cinder-quobyte-204c02aa-aa91-4530-87be-4ec9ac6684bd" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "cinder-quobyte-204c02aa-aa91-4530-87be-4ec9ac6684bd" acquired by "delete_volume" :: waited 0.112s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b83d6-69f4-4939-a559-a9cd31d9bf40]: (4, 'raw') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0" returned: 0 in 0.738s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:45 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 0 in 0.546s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ec51691c-6be2-481d-9309-e40890df09b0" returned: 0 in 0.288s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-ec51691c-6be2-481d-9309-e40890df09b0" released by "delete_volume" :: held 1.360s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:46 devstack quobyte-client[82905]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 1 in 0.660s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd' failed. Not Retrying. {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 10 19:53:46 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-204c02aa-aa91-4530-87be-4ec9ac6684bd" returned: 0 in 0.331s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "cinder-quobyte-204c02aa-aa91-4530-87be-4ec9ac6684bd" released by "delete_volume" :: held 1.793s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Created reservations ['8eb75eb3-8419-4a20-8973-ca57cf49ff17', 'fec3d600-1f0b-4cfc-8e68-572c509017a0', 'ca716c7d-6f48-4de7-bc28-179fe957c6ae', 'e59b0dd7-46ac-4d17-8028-51e78dfe35ed'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['7320f974-01d6-4e2c-93fd-054b0702fecd', '11893ffc-e4b8-447f-9eac-a7de8cc791e0', '648a09a0-84f8-4f60-96ef-70219bb7f8f8', '0ad49c5e-19a6-44f8-a766-27d1eb75df0d'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:47 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.208s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:48 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Deleted volume successfully.
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-bd419f6d-8787-44ce-8511-5177df04baf5-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-100a3c8e-7fd1-478b-9d58-2d12f1420707 tempest-VolumeImageDependencyTests-2143163171 None] Lock "cinder-204c02aa-aa91-4530-87be-4ec9ac6684bd-delete_volume" released by "delete_volume" :: held 3.943s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.571s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:48 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-bd419f6d-8787-44ce-8511-5177df04baf5-delete_volume" acquired by "delete_volume" :: waited 0.246s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:49 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:53:49 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-bd419f6d-8787-44ce-8511-5177df04baf5" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-1f37c9ae-f2ce-4ffa-9d8e-4142f2424bde tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-ec51691c-6be2-481d-9309-e40890df09b0-delete_volume" released by "delete_volume" :: held 4.378s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-bd419f6d-8787-44ce-8511-5177df04baf5" acquired by "delete_volume" :: waited 0.021s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[a599142f-36fb-4949-9064-8a3962db192a]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:49 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:49 devstack quobyte-client[82905]: System call of process 100599 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5" returned: 0 in 0.681s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:50 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-bd419f6d-8787-44ce-8511-5177df04baf5" returned: 0 in 0.218s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:50 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-bd419f6d-8787-44ce-8511-5177df04baf5" released by "delete_volume" :: held 1.223s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:50 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['ecf00842-fbea-43a1-9656-45edb2ef2529', 'cfc5189e-aa98-4153-8b87-cb957359ac00', '05cf1b68-9a76-48b2-ad67-8c3ab2e247af', '44f7b6bc-68e4-4b25-9b5a-900c1d917f1b'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.152s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:51 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:53:51 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-fe84f438-499b-48e3-a965-26703bc7bfa3 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-bd419f6d-8787-44ce-8511-5177df04baf5-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-a45827a1-6db0-4695-a8fb-9f34e87e3738-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-a45827a1-6db0-4695-a8fb-9f34e87e3738-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:52 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-a45827a1-6db0-4695-a8fb-9f34e87e3738" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-a45827a1-6db0-4695-a8fb-9f34e87e3738" acquired by "delete_volume" :: waited 0.031s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4e141-6245-4fb3-a951-20de3d8257cd]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:52 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738" returned: 0 in 0.837s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:53 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-a45827a1-6db0-4695-a8fb-9f34e87e3738" returned: 0 in 0.183s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:53 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-a45827a1-6db0-4695-a8fb-9f34e87e3738" released by "delete_volume" :: held 1.257s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['381bd0d8-13c8-4a47-9be8-929b2257f57c', 'e833fa8b-b46e-4539-9421-7d09c245ea66', '18b98a18-f5aa-4db8-9acb-5148dccd5bce', '91823d9e-b59d-4ca5-96ae-b6d3e894fca6'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.123s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:54 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-923730d2-a0eb-415b-bbe7-7a8674562c70-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-b2d9179f-166f-4608-893b-e42146028705 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-a45827a1-6db0-4695-a8fb-9f34e87e3738-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:54 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-923730d2-a0eb-415b-bbe7-7a8674562c70-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:55 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-923730d2-a0eb-415b-bbe7-7a8674562c70" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:55 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-923730d2-a0eb-415b-bbe7-7a8674562c70" acquired by "delete_volume" :: waited 0.022s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:55 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[119f7a3d-3a6f-4c6e-806f-a43cc7950ac1]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:55 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:56 devstack quobyte-client[82905]: System call of process 100650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:56 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Flow 'volume_create_manager' (050cb9c7-c6e3-4672-82d6-5fa05b4bd177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99054ff7-bbec-430a-ab7e-5a1f21554822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99054ff7-bbec-430a-ab7e-5a1f21554822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5146674b-3d95-4f71-a2dc-63d483ac9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9ecd8d35c24a5d9eaf2a1e0a4e504b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:56Z,use_quota=True,user_id='60660485599f4a1da628e81258f8b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61653ec3-f491-40a4-9ccb-71c45d26a95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61653ec3-f491-40a4-9ccb-71c45d26a95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdaf596-4937-4882-94ec-de820e97e6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cdaf596-4937-4882-94ec-de820e97e6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5146674b-3d95-4f71-a2dc-63d483ac9af2', 'volume_name': 'volume-5146674b-3d95-4f71-a2dc-63d483ac9af2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a7bf0-cbf7-452e-bcf3-9593d890ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a7bf0-cbf7-452e-bcf3-9593d890ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ece49f-1136-4661-aae1-3b32cdc1af2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:56 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Volume 5146674b-3d95-4f71-a2dc-63d483ac9af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5146674b-3d95-4f71-a2dc-63d483ac9af2', 'volume_size': 1}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5146674b-3d95-4f71-a2dc-63d483ac9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9ecd8d35c24a5d9eaf2a1e0a4e504b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:56Z,use_quota=True,user_id='60660485599f4a1da628e81258f8b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Creating volume 5146674b-3d95-4f71-a2dc-63d483ac9af2 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:56 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:56 devstack quobyte-client[82905]: System call of process 100653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70" returned: 0 in 1.326s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:56 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=170, name=volume-5146674b-3d95-4f71-a2dc-63d483ac9af2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-923730d2-a0eb-415b-bbe7-7a8674562c70" returned: 0 in 0.280s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 1073741824" returned: 0 in 0.510s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:56 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2" returned: 0 in 0.327s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] <== create_volume: return (901ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-923730d2-a0eb-415b-bbe7-7a8674562c70" released by "delete_volume" :: held 2.254s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ece49f-1136-4661-aae1-3b32cdc1af2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5146674b-3d95-4f71-a2dc-63d483ac9af2', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcd800c-cec8-444e-a4a3-686c107f7566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:57 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Volume volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 (5146674b-3d95-4f71-a2dc-63d483ac9af2): created successfully
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bcd800c-cec8-444e-a4a3-686c107f7566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Flow 'volume_create_manager' (050cb9c7-c6e3-4672-82d6-5fa05b4bd177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['e207d56b-d03d-4972-9fe1-785f71040a2f', '40a65343-450d-40c6-909c-b3ec92629826', '3a81e2f5-21f9-4610-823f-587eeddbf5f7', '8ceaea37-7945-4ca6-9e30-bf1221486df9'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:53:57 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-3d1bd8d0-9f48-44d5-b60d-8771beb54971 tempest-CinderUnicodeTest-200057086 None] Created volume successfully.
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:57 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.293s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:53:58 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-ced3cc67-ae63-42bd-9644-aae99b34c5d5-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-ced3cc67-ae63-42bd-9644-aae99b34c5d5-delete_volume" acquired by "delete_volume" :: waited 0.192s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-2c5d1757-47cf-4c68-81c6-4e69ee089380 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-923730d2-a0eb-415b-bbe7-7a8674562c70-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:53:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-ced3cc67-ae63-42bd-9644-aae99b34c5d5" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:53:58 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82863) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 10 19:53:58 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Flow 'volume_create_manager' (1d9f6325-2edd-4484-a7d8-7c4c0aab29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2964b0-b964-4c7d-bde4-fd424b15f35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2964b0-b964-4c7d-bde4-fd424b15f35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1388364312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422cf922-3e09-4ad6-ae66-0bcf340ea545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9ecd8d35c24a5d9eaf2a1e0a4e504b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:59Z,use_quota=True,user_id='60660485599f4a1da628e81258f8b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d7c148-2dba-4f80-91f2-ab7f9b356e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d7c148-2dba-4f80-91f2-ab7f9b356e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff69771-b289-48fa-abe2-76b31562f683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff69771-b289-48fa-abe2-76b31562f683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422cf922-3e09-4ad6-ae66-0bcf340ea545', 'volume_name': 'volume-422cf922-3e09-4ad6-ae66-0bcf340ea545', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8b99ed-6677-4401-9131-5e0bdf7325cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8b99ed-6677-4401-9131-5e0bdf7325cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0390614e-a326-409e-8e55-a164539fee0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:53:59 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Volume 422cf922-3e09-4ad6-ae66-0bcf340ea545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422cf922-3e09-4ad6-ae66-0bcf340ea545', 'volume_size': 1}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f7c17d77b50>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-10T17:53:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1388364312',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422cf922-3e09-4ad6-ae66-0bcf340ea545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d9ecd8d35c24a5d9eaf2a1e0a4e504b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T17:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T17:53:59Z,use_quota=True,user_id='60660485599f4a1da628e81258f8b1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a71580da-67e5-40c6-a3a1-a27e53bc21ab),volume_type_id=a71580da-67e5-40c6-a3a1-a27e53bc21ab)}" {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Creating volume 422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Selected 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779 as target Quobyte volume. {{(pid=82863) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 10 19:53:59 devstack cinder-volume[82863]: INFO cinder.volume.drivers.remotefs [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] casted to 10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 1073741824 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-ced3cc67-ae63-42bd-9644-aae99b34c5d5" acquired by "delete_volume" :: waited 0.333s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:53:59 devstack quobyte-client[82905]: System call of process 100659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[00246b6c-5159-4b23-9514-67566e26747d]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:53:59 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=171, name=volume-422cf922-3e09-4ad6-ae66-0bcf340ea545, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 1073741824" returned: 0 in 0.648s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:53:59 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545" returned: 0 in 0.176s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] <== create_volume: return (963ms) {'provider_location': '10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'} {{(pid=82863) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:00 devstack quobyte-client[82905]: System call of process 100662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0390614e-a326-409e-8e55-a164539fee0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422cf922-3e09-4ad6-ae66-0bcf340ea545', 'volume_size': 1}' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e99fba-5d0a-4e43-a801-9c8877d2de54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5" returned: 0 in 1.067s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:00 devstack cinder-volume[82863]: INFO cinder.volume.flows.manager.create_volume [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Volume volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 (422cf922-3e09-4ad6-ae66-0bcf340ea545): created successfully
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e99fba-5d0a-4e43-a801-9c8877d2de54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82863) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 10 19:54:00 devstack cinder-volume[82863]: DEBUG cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Flow 'volume_create_manager' (1d9f6325-2edd-4484-a7d8-7c4c0aab29d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82863) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-ced3cc67-ae63-42bd-9644-aae99b34c5d5" returned: 0 in 0.566s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:01 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-fce8fcc5-f00e-468f-b679-d2902964d176 tempest-CinderUnicodeTest-200057086 None] Created volume successfully.
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-ced3cc67-ae63-42bd-9644-aae99b34c5d5" released by "delete_volume" :: held 1.897s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['4c467d38-46b7-4a6a-81fc-e1dcc316ebbd', 'e08c7cf3-74a1-4273-9bed-445578fdfcd0', '2bd7de06-e83b-4812-8420-87db6f1a5823', '1dc3903d-b8f8-4ef3-a332-a4365f573e1f'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.367s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:01 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:54:02 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-4cd7a861-7f54-4086-97b6-334e2bfc8c8f-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Creating offline snapshot 5c51a8ee-63f4-4b41-a633-ac8e4acef6ed of volume 422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ff00b7-e622-45ac-8528-00d921a75373]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-4cd7a861-7f54-4086-97b6-334e2bfc8c8f-delete_volume" acquired by "delete_volume" :: waited 0.332s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-c60241c2-777d-47a5-9c21-557bbbfa47f9 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-ced3cc67-ae63-42bd-9644-aae99b34c5d5-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:02 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "cinder-quobyte-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" acquired by "delete_volume" :: waited 0.035s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c58e100-39c0-4358-b0e8-408bf873a848]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:02 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545" returned: 0 in 0.981s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed 1G {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:03 devstack quobyte-client[82905]: The server volume:b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=b6ab15fe-a76b-49a7-9dfb-ab7db6b593c1, inode=172, name=volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.70), requestorAccessMask=0
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed 1G" returned: 0 in 0.312s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): qemu-img rebase -u -b volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:03 devstack quobyte-client[82905]: System call of process 100674 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" returned: 0 in 0.866s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:03 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "qemu-img rebase -u -b volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 -F qcow2 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.388s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" returned: 0 in 0.241s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-quobyte-4cd7a861-7f54-4086-97b6-334e2bfc8c8f" released by "delete_volume" :: held 1.379s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.419s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Setting permissions: /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 -> 1000:1000 {{(pid=82863) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.302s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:04 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.info" returned: 0 in 0.269s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] File path /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.info is being set with permissions: 660 {{(pid=82863) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.info {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.info" returned: 0 in 0.294s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.319s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Created reservations ['f796a9f3-704b-455b-a562-04eef6480ac6', '73d576d5-6373-4a39-9cbb-3000e8465602', 'b260be89-0f74-4961-88c7-213678cbd608', '8bc86921-64b0-4d75-8c84-5b0491dbeadc'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:54:05 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-70e17870-052a-4fa2-b764-de9d0e8c5a2b tempest-CinderUnicodeTest-200057086 None] Create snapshot completed successfully
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:05 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.119s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:54:06 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Deleted volume successfully.
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed-delete_snapshot" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-aacd5ee3-3288-4420-a7ce-687081090e86 tempest-CreateVolumesFromSourceVolumeTest-1824346336 None] Lock "cinder-4cd7a861-7f54-4086-97b6-334e2bfc8c8f-delete_volume" released by "delete_volume" :: held 4.026s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:06 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" by "delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-quobyte-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" by "_delete_snapshot" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Deleting offline snapshot 5c51a8ee-63f4-4b41-a633-ac8e4acef6ed of volume 422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] snapshot_file for this snap is: volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[89836a16-34ae-4c74-b2d9-56b282023232]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:06 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:07 devstack quobyte-client[82905]: System call of process 100690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.555s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.remotefs [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422cf922-3e09-4ad6-ae66-0bcf340ea545(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82863) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0510b8-f8bf-459c-b07f-ad02834c55d6]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545" returned: 0 in 0.525s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:07 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.279s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545.5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" returned: 0 in 0.122s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed" released by "_delete_snapshot" :: held 1.920s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" released by "delete_snapshot" :: held 1.962s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:08 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Created reservations ['c822999f-1fac-43c6-a16c-c5d38795d69c', 'd7436a4a-a8b6-43b9-a27a-ea33a6a7dd65', '1493b68b-0c69-4399-b857-c550ecdd0500', '3f5fa27e-298c-4ae1-8f32-d893415ecfd4'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:54:09 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Delete snapshot completed successfully.
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-ccfdc469-6a6c-48cd-9064-5835b4cf2c07 tempest-CinderUnicodeTest-200057086 None] Lock "cinder-5c51a8ee-63f4-4b41-a633-ac8e4acef6ed-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-422cf922-3e09-4ad6-ae66-0bcf340ea545-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "cinder-422cf922-3e09-4ad6-ae66-0bcf340ea545-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:09 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" acquired by "delete_volume" :: waited 0.012s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[6168fff0-904d-4f04-a651-715d496bc315]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:09 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545" returned: 0 in 0.420s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-422cf922-3e09-4ad6-ae66-0bcf340ea545" returned: 0 in 0.095s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-422cf922-3e09-4ad6-ae66-0bcf340ea545" released by "delete_volume" :: held 0.681s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Created reservations ['c14311bb-34b5-48ce-9f4a-e77f0eba5b5b', 'b55d675f-824f-4b24-83f1-3c362153d79d', 'df7280c0-e96f-4063-ae4e-a2ae59d77d30', '06a5934e-f937-47fe-af65-fd1ab644cda1'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:10 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:11 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.084s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:11 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:54:11 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Deleted volume successfully.
Sep 10 19:54:11 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-72dcdbdc-dbbd-4693-aff8-3d5b4c36d00c tempest-CinderUnicodeTest-200057086 None] Lock "cinder-422cf922-3e09-4ad6-ae66-0bcf340ea545-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-5146674b-3d95-4f71-a2dc-63d483ac9af2-delete_volume" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "cinder-5146674b-3d95-4f71-a2dc-63d483ac9af2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:12 devstack cinder-volume[82863]: WARNING cinder.volume.volume_utils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Acquiring lock "cinder-quobyte-5146674b-3d95-4f71-a2dc-63d483ac9af2" by "delete_volume" {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-5146674b-3d95-4f71-a2dc-63d483ac9af2" acquired by "delete_volume" :: waited 0.009s {{(pid=82863) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f6799-d341-45f4-ab2f-c51145398167]: (4, 'qcow2') {{(pid=83876) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2" returned: 0 in 0.383s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] CMD "rm -f /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789/volume-5146674b-3d95-4f71-a2dc-63d483ac9af2" returned: 0 in 0.106s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:12 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "cinder-quobyte-5146674b-3d95-4f71-a2dc-63d483ac9af2" released by "delete_volume" :: held 0.633s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG cinder.quota [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Created reservations ['fbcd734d-e8c9-485a-bd77-c3b2a22d55d1', 'c05f649c-4274-4022-bdbc-525fcc2c1aeb', '71cfcbb2-0047-4cc9-baa7-1d1dec7ed2cd', '2ae94f9c-be6e-4319-be5c-d13f5bb79f34'] {{(pid=82863) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.102s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 10 19:54:13 devstack cinder-volume[82863]: INFO cinder.volume.manager [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Deleted volume successfully.
Sep 10 19:54:13 devstack cinder-volume[82863]: DEBUG cinder.coordination [None req-8bab0833-a4ee-4736-a033-e64fd31ecdde tempest-CinderUnicodeTest-200057086 None] Lock "cinder-5146674b-3d95-4f71-a2dc-63d483ac9af2-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82863) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 10 19:54:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:SELECT=87,cinder:UPDATE=113,cinder:INSERT=28,cinder:DELETE=9 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:54:23 devstack cinder-volume[82863]: DEBUG dbcounter [-] [82863] Writing DB stats cinder:UPDATE=128,cinder:DELETE=13,cinder:SELECT=70,cinder:INSERT=32 {{(pid=82863) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_service.periodic_task [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82863) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779': None} {{(pid=82863) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG cinder.volume.drivers.quobyte [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Available shares ['10.10.41.181/cinder-vol-1ce192d2-39fb-49d3-9df5-68a058932779'] {{(pid=82863) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.lockutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82863) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789 {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG oslo_concurrency.processutils [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/a69676da575201f8d40656a784fab789" returned: 0 in 0.107s {{(pid=82863) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 10 19:54:38 devstack cinder-volume[82863]: DEBUG cinder.manager [None req-f23a51f7-39ca-429c-a924-d3ada2889971 None None] Notifying Schedulers of capabilities ... {{(pid=82863) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}